us.codecraft:webmagic-core

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

License

License

Categories

Categories

webmagic Business Logic Libraries Web Crawling
GroupId

GroupId

us.codecraft
ArtifactId

ArtifactId

webmagic-core
Last Version

Last Version

0.7.5
Release Date

Release Date

Type

Type

jar
Description

Description

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

Download webmagic-core

How to add to project

<!-- https://jarcasting.com/artifacts/us.codecraft/webmagic-core/ -->
<dependency>
    <groupId>us.codecraft</groupId>
    <artifactId>webmagic-core</artifactId>
    <version>0.7.5</version>
</dependency>
// https://jarcasting.com/artifacts/us.codecraft/webmagic-core/
implementation 'us.codecraft:webmagic-core:0.7.5'
// https://jarcasting.com/artifacts/us.codecraft/webmagic-core/
implementation ("us.codecraft:webmagic-core:0.7.5")
'us.codecraft:webmagic-core:jar:0.7.5'
<dependency org="us.codecraft" name="webmagic-core" rev="0.7.5">
  <artifact name="webmagic-core" type="jar" />
</dependency>
@Grapes(
@Grab(group='us.codecraft', module='webmagic-core', version='0.7.5')
)
libraryDependencies += "us.codecraft" % "webmagic-core" % "0.7.5"
[us.codecraft/webmagic-core "0.7.5"]

Dependencies

compile (9)

Group / Artifact Type Version
org.apache.httpcomponents : httpclient jar 4.5.13
org.apache.commons : commons-lang3 jar 3.11
us.codecraft : xsoup jar 0.3.2
org.slf4j : slf4j-api jar 1.7.30
org.slf4j : slf4j-log4j12 Optional jar 1.7.30
commons-collections : commons-collections jar 3.2.2
commons-io : commons-io jar 2.8.0
com.jayway.jsonpath : json-path jar 2.5.0
com.alibaba : fastjson jar 1.2.75

test (4)

Group / Artifact Type Version
junit : junit jar 4.13.1
com.github.dreamhead : moco-core jar 1.2.0
org.mockito : mockito-all jar 1.10.19
org.assertj : assertj-core jar 3.18.1

Project Modules

There are no modules declared in this project.

Versions

Version
0.7.5
0.7.4
0.7.3
0.7.2
0.7.1
0.7.0
0.7.0.alpha
0.6.1
0.6.0
0.5.3
0.5.2
0.5.1
0.5.0
0.4.3
0.4.2
0.4.1
0.4.0
0.3.2
0.3.1
0.3.0
0.2.1