pyscrapper.assembly.observers

API

class pyscrapper.assembly.observers.Observable

An observable who holds a list of observers. Any concrete class implementing this interface can add / remove observers

add_observer(observer: pyscrapper.assembly.observers.Observer)

Add observer to observers list

remove_observer(observer: pyscrapper.assembly.observers.Observer)

Removes an observer from list of observers.

class pyscrapper.assembly.observers.Observer

An observer, which is observed and updated / notified on change

on_parse_completed(url, obj, **kwargs)

This method is called when parsing of response html is completed, as per given configuration.

on_url_loaded(url, response, **kwargs)

This method is called when url’s http response is received

Parameters:

• url – The url which is being loaded
• response – The html response of the http request

class pyscrapper.assembly.observers.CallbackObserver(callbacks=None, url_callbacks=None)

Bases: pyscrapper.assembly.observers.Observer

An observer which calls given list of callback methods, on completion of actual Observable’s task url_callbacks=None : callback methods, which need to be called on loading of url is completed callbacks=None : callback methods, which need to be called on parsing is completed

add_callback(callback)

Add callback method to callbacks list…

add_url_callback(callback)

Add callback method to url_callbacks list

on_parse_completed(url, obj, *args, **kwargs)

This method is called when parsing of response html is completed, as per given configuration.

on_url_loaded(url, response, *args, **kwargs)

Calls back the callbacks when url is loaded

remove(callback)

Remove callback method from callbacks list…

remove_url_callback(callback)

Remove callback method from url callbacks list