com.github.ancienter:webmagic-extension

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

License

License

Categories

Categories

webmagic Business Logic Libraries Web Crawling
GroupId

GroupId

com.github.ancienter
ArtifactId

ArtifactId

webmagic-extension
Last Version

Last Version

v2020.6.17
Release Date

Release Date

Type

Type

jar
Description

Description

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

Download webmagic-extension

How to add to project

<!-- https://jarcasting.com/artifacts/com.github.ancienter/webmagic-extension/ -->
<dependency>
    <groupId>com.github.ancienter</groupId>
    <artifactId>webmagic-extension</artifactId>
    <version>v2020.6.17</version>
</dependency>
// https://jarcasting.com/artifacts/com.github.ancienter/webmagic-extension/
implementation 'com.github.ancienter:webmagic-extension:v2020.6.17'
// https://jarcasting.com/artifacts/com.github.ancienter/webmagic-extension/
implementation ("com.github.ancienter:webmagic-extension:v2020.6.17")
'com.github.ancienter:webmagic-extension:jar:v2020.6.17'
<dependency org="com.github.ancienter" name="webmagic-extension" rev="v2020.6.17">
  <artifact name="webmagic-extension" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.github.ancienter', module='webmagic-extension', version='v2020.6.17')
)
libraryDependencies += "com.github.ancienter" % "webmagic-extension" % "v2020.6.17"
[com.github.ancienter/webmagic-extension "v2020.6.17"]

Dependencies

compile (3)

Group / Artifact Type Version
redis.clients : jedis jar 2.9.3
com.google.guava : guava Optional jar 29.0-jre
com.github.ancienter : webmagic-core jar v2020.6.17

test (1)

Group / Artifact Type Version
junit : junit jar 4.13

Project Modules

There are no modules declared in this project.

Versions

Version
v2020.6.17