Skraper Versions Save

Kotlin/Java library and cli tool for scraping posts and media from various sources with neither authorization nor full page rendering (Facebook, Instagram, Twitter, Youtube, Tiktok, Telegram, Twitch, Reddit, 9GAG, Pinterest, Flickr, Tumblr, Coub, Vimeo, IFunny, VK, Odnoklassniki, Pikabu)

0.8.3

2 years ago

What's Changed

Bump spring-boot.version from 2.6.1 to 2.6.2 by @dependabot in https://github.com/sokomishalov/skraper/pull/240
Bump kotlinx-coroutines-reactive from 1.5.2 to 1.6.0 by @dependabot in https://github.com/sokomishalov/skraper/pull/241
Bump logback-classic from 1.2.9 to 1.2.10 by @dependabot in https://github.com/sokomishalov/skraper/pull/242
Bump telegrambots-spring-boot-starter from 5.5.0 to 5.6.0 by @dependabot in https://github.com/sokomishalov/skraper/pull/244
Bump dokka-maven-plugin from 1.6.0 to 1.6.10 by @dependabot in https://github.com/sokomishalov/skraper/pull/243
Bump reactor-netty from 1.0.14 to 1.0.15 by @dependabot in https://github.com/sokomishalov/skraper/pull/245
Bump spring-webflux from 5.3.14 to 5.3.15 by @dependabot in https://github.com/sokomishalov/skraper/pull/246
Bump spring-boot.version from 2.6.2 to 2.6.3 by @dependabot in https://github.com/sokomishalov/skraper/pull/247
Bump telegrambots-spring-boot-starter from 5.6.0 to 5.7.1 by @dependabot in https://github.com/sokomishalov/skraper/pull/248

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.8.2...0.8.3

0.8.2

2 years ago

What's Changed

Bump ktor.version from 1.6.4 to 1.6.6 by @dependabot in https://github.com/sokomishalov/skraper/pull/230
Bump spring-boot.version from 2.6.0 to 2.6.1 by @dependabot in https://github.com/sokomishalov/skraper/pull/231
Bump telegrambots-spring-boot-starter from 5.4.0.1 to 5.5.0 by @dependabot in https://github.com/sokomishalov/skraper/pull/233

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.8.1...0.8.2

0.8.1

2 years ago

What's Changed

Bump logback-classic from 1.2.4 to 1.2.5 by @dependabot in https://github.com/sokomishalov/skraper/pull/188
Bump ktor.version from 1.6.1 to 1.6.2 by @dependabot in https://github.com/sokomishalov/skraper/pull/189
Bump reactor-netty from 1.0.9 to 1.0.10 by @dependabot in https://github.com/sokomishalov/skraper/pull/190
Bump jsoup from 1.14.1 to 1.14.2 by @dependabot in https://github.com/sokomishalov/skraper/pull/191
Bump logbook-spring-boot-webflux-autoconfigure from 2.11.0 to 2.12.0 by @dependabot in https://github.com/sokomishalov/skraper/pull/192
Bump spring-boot.version from 2.5.3 to 2.5.4 by @dependabot in https://github.com/sokomishalov/skraper/pull/193
Bump kotlin.version from 1.5.21 to 1.5.30 by @dependabot in https://github.com/sokomishalov/skraper/pull/195
Added Search feature to Youtube Scraper by @OmarELRayes in https://github.com/sokomishalov/skraper/pull/194
Bump ktor.version from 1.6.2 to 1.6.3 by @dependabot in https://github.com/sokomishalov/skraper/pull/196
Bump jackson.version from 2.12.4 to 2.12.5 by @dependabot in https://github.com/sokomishalov/skraper/pull/197
Bump kotlinx-coroutines-reactive from 1.5.1 to 1.5.2 by @dependabot in https://github.com/sokomishalov/skraper/pull/198
Bump logbook-spring-boot-webflux-autoconfigure from 2.12.0 to 2.13.0 by @dependabot in https://github.com/sokomishalov/skraper/pull/199
Bump maven-javadoc-plugin from 3.3.0 to 3.3.1 by @dependabot in https://github.com/sokomishalov/skraper/pull/200
Bump logback-classic from 1.2.5 to 1.2.6 by @dependabot in https://github.com/sokomishalov/skraper/pull/201
Bump reactor-netty from 1.0.10 to 1.0.11 by @dependabot in https://github.com/sokomishalov/skraper/pull/202
Bump spring-webflux from 5.3.9 to 5.3.10 by @dependabot in https://github.com/sokomishalov/skraper/pull/203
Bump dokka-maven-plugin from 1.5.0 to 1.5.30 by @dependabot in https://github.com/sokomishalov/skraper/pull/204
Bump kotlin.version from 1.5.30 to 1.5.31 by @dependabot in https://github.com/sokomishalov/skraper/pull/205
Bump jackson.version from 2.12.5 to 2.13.0 by @dependabot in https://github.com/sokomishalov/skraper/pull/206
Bump okhttp from 4.9.1 to 4.9.2 by @dependabot in https://github.com/sokomishalov/skraper/pull/208
Bump jsoup from 1.14.2 to 1.14.3 by @dependabot in https://github.com/sokomishalov/skraper/pull/207
Bump ktor.version from 1.6.3 to 1.6.4 by @dependabot in https://github.com/sokomishalov/skraper/pull/209
Bump dokka-maven-plugin from 1.5.30 to 1.5.31 by @dependabot in https://github.com/sokomishalov/skraper/pull/210
Bump reactor-netty from 1.0.11 to 1.0.12 by @dependabot in https://github.com/sokomishalov/skraper/pull/212
Bump logbook-spring-boot-webflux-autoconfigure from 2.13.0 to 2.14.0 by @dependabot in https://github.com/sokomishalov/skraper/pull/211
Bump spring-webflux from 5.3.10 to 5.3.11 by @dependabot in https://github.com/sokomishalov/skraper/pull/213
Bump spring-boot.version from 2.5.5 to 2.5.6 by @dependabot in https://github.com/sokomishalov/skraper/pull/214
Bump spring-webflux from 5.3.11 to 5.3.12 by @dependabot in https://github.com/sokomishalov/skraper/pull/215
Bump ktor.version from 1.6.4 to 1.6.5 by @dependabot in https://github.com/sokomishalov/skraper/pull/216
Bump telegrambots-spring-boot-starter from 5.3.0 to 5.4.0 by @dependabot in https://github.com/sokomishalov/skraper/pull/217
Bump reactor-netty from 1.0.12 to 1.0.13 by @dependabot in https://github.com/sokomishalov/skraper/pull/218
Bump logback-classic from 1.2.6 to 1.2.7 by @dependabot in https://github.com/sokomishalov/skraper/pull/219
Bump spring-webflux from 5.3.12 to 5.3.13 by @dependabot in https://github.com/sokomishalov/skraper/pull/220
Bump kotlin.version from 1.5.31 to 1.6.0 by @dependabot in https://github.com/sokomishalov/skraper/pull/221
Bump telegrambots-spring-boot-starter from 5.4.0 to 5.4.0.1 by @dependabot in https://github.com/sokomishalov/skraper/pull/222
Bump spring-boot.version from 2.5.6 to 2.6.0 by @dependabot in https://github.com/sokomishalov/skraper/pull/227
Bump okhttp from 4.9.2 to 4.9.3 by @dependabot in https://github.com/sokomishalov/skraper/pull/228
Bump dokka-maven-plugin from 1.5.31 to 1.6.0 by @dependabot in https://github.com/sokomishalov/skraper/pull/229

New Contributors

@OmarELRayes made their first contribution in https://github.com/sokomishalov/skraper/pull/194

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.8.0...0.8.1

0.8.0

2 years ago

getPosts and extensions for it should return Flow<Post>and be paginable.
add statistics field to Post, which includes likes, reposts, views and comments amount fields.
add statistics field to PageInfo, which includes posts, followers and following amount fields.
remove baseUrl from Skraper interface
provide UnknownMedia type
various extraction fixes

Full changelog

0.7.0

3 years ago

Changelog:

tiktok implemented
telegram implemented
instagram: hashtag posts + some improvements
clients rework
post's publishedAt is an instance of Instant
migrate tests to junit 5
page info refactoring: covers and avatars are single-imaged now
maven central distribution
some refactoring
dependency upgrades

0.6.3

3 years ago

Fixed https://github.com/sokomishalov/skraper/issues/48
Bump deps

0.6.2

3 years ago

Youtube fix
bump versions

0.6.1

3 years ago

Add postCount and followerCount for Pinterest (https://github.com/sokomishalov/skraper/pull/92) Bump deps

0.6.0

3 years ago

Changelog:

bump kotlin to 1.4.0 and other dep upgrades
fixes #76
fixes #77

0.5.1

3 years ago

Changes:

https://github.com/SokoMishaLov/skraper/issues/55
bump versions