intelmq.bots.collectors.http package

Submodules

intelmq.bots.collectors.http.collector_http module

HTTP collector bot

param http_url

type http_url

string

param http_header

default: {}

type http_header

dictionary

param http_verify_cert

default: True

type http_verify_cert

boolean

param extract_files

value used to extract files from downloaded compressed file default: None all: True; some: string with file names separated by ,

param http_url_formatting

to turn on time formatting (and to specify delta to current time)

type http_url_formatting

bool|json

param http_username

type http_username

string

param http_password

type http_password

string

param http_proxy

type http_proxy

string

param https_proxy

type https_proxy

string

param http_timeout_sec

tuple of two floats or float

param http_timeout_max_tries

an integer depicting how often a connection attempt is retried

type http_timeout_max_tries

int

param verify_pgp_signatures

whether to download and check file signatures default: False

type verify_pgp_signatures

bool

param signature_url

type signature_url

string

param signature_url_formatting

the same as http_url_formatting

param gpg_keyring

none (defaults to user’s GPG keyring) or string (path to keyring file)

intelmq.bots.collectors.http.collector_http.BOT

alias of intelmq.bots.collectors.http.collector_http.HTTPCollectorBot

class intelmq.bots.collectors.http.collector_http.HTTPCollectorBot(bot_id: str, start: bool = False, sighup_event=None, disable_multithreading: Optional[bool] = None)

Bases: intelmq.lib.bot.CollectorBot, intelmq.lib.mixins.http.HttpMixin

Fetch reports from an URL

extract_files: bool = False
format_url(url: str, formatting) str
gpg_keyring: str = None
http_password: str = None
http_url: str = '<insert url of feed>'
http_url_formatting: bool = False
http_username: str = None
init()
process()
rate_limit: int = 3600
signature_url: str = None
signature_url_formatting: bool = False
ssl_client_certificate: str = None
verify_pgp_signatures: bool = False
verify_signature(data: bytes)

Download signature file and verify the report data.

class intelmq.bots.collectors.http.collector_http.Time(delta=None)

Bases: object

__init__(delta=None)

Delta is a datetime.timedelta JSON string, ex: ‘{“days”=-1}’.

intelmq.bots.collectors.http.collector_http_stream module

HTTP collector bot

param http_url

string

param http_header

dictionary default: {}

param http_verify_cert

boolean default: True

param http_username

string

param http_password

string

param http_proxy

string

param https_proxy

string

param strip_lines

boolean

param http_timeout_sec

tuple of two floats or float

intelmq.bots.collectors.http.collector_http_stream.BOT

alias of intelmq.bots.collectors.http.collector_http_stream.HTTPStreamCollectorBot

class intelmq.bots.collectors.http.collector_http_stream.HTTPStreamCollectorBot(bot_id: str, start: bool = False, sighup_event=None, disable_multithreading: Optional[bool] = None)

Bases: intelmq.lib.bot.CollectorBot, intelmq.lib.mixins.http.HttpMixin

Open a streaming connection to the URL and process data per line

http_password: str = None
http_url: str = '<insert url of feed>'
http_username: str = None
init()
process()
rate_limit: int = 3600
ssl_client_certificate: str = None
strip_lines: bool = True

Module contents