storm-crawler

A collection of resources for building low-latency, scalable web crawlers on Apache Storm.

License

License

Categories

Categories

ORM Data StormCrawler Business Logic Libraries Web Crawling
GroupId

GroupId

com.digitalpebble.stormcrawler
ArtifactId

ArtifactId

storm-crawler
Last Version

Last Version

2.4
Release Date

Release Date

Type

Type

pom
Description

Description

storm-crawler
A collection of resources for building low-latency, scalable web crawlers on Apache Storm.
Project URL

Project URL

http://stormcrawler.net/
Project Organization

Project Organization

DigitalPebble Ltd
Source Code Management

Source Code Management

https://github.com/DigitalPebble/storm-crawler

Download storm-crawler

Filename Size
storm-crawler-2.4.pom 6 KB
Browse

How to add to project

<!-- https://jarcasting.com/artifacts/com.digitalpebble.stormcrawler/storm-crawler/ -->
<dependency>
    <groupId>com.digitalpebble.stormcrawler</groupId>
    <artifactId>storm-crawler</artifactId>
    <version>2.4</version>
    <type>pom</type>
</dependency>
// https://jarcasting.com/artifacts/com.digitalpebble.stormcrawler/storm-crawler/
implementation 'com.digitalpebble.stormcrawler:storm-crawler:2.4'
// https://jarcasting.com/artifacts/com.digitalpebble.stormcrawler/storm-crawler/
implementation ("com.digitalpebble.stormcrawler:storm-crawler:2.4")
'com.digitalpebble.stormcrawler:storm-crawler:pom:2.4'
<dependency org="com.digitalpebble.stormcrawler" name="storm-crawler" rev="2.4">
  <artifact name="storm-crawler" type="pom" />
</dependency>
@Grapes(
@Grab(group='com.digitalpebble.stormcrawler', module='storm-crawler', version='2.4')
)
libraryDependencies += "com.digitalpebble.stormcrawler" % "storm-crawler" % "2.4"
[com.digitalpebble.stormcrawler/storm-crawler "2.4"]

Dependencies

There are no dependencies for this project. It is a standalone project that does not depend on any other jars.

Project Modules

  • core
  • external
  • external/aws
  • external/elasticsearch
  • external/langid
  • external/solr
  • external/sql
  • external/tika
  • external/urlfrontier
  • external/warc
  • archetype
  • external/elasticsearch/archetype
com.digitalpebble.stormcrawler

DigitalPebble Ltd

Versions

Version
2.4
2.3
2.2
2.1
2.0
1.18
1.17
1.16
1.15
1.14
1.13
1.12.1
1.12
1.11
1.10
1.9
1.8
1.7
1.6
1.5.1
1.5
1.4
1.3
1.2
1.1.1
1.1
1.0
0.10
0.9
0.8