Datapumps isolated

Isolated library for datapumps creation and testing.

   

Installation

This package is NOT published on PyPI.

pip install --upgrade git+git://github.com/radeksvarz/datapumps_isolated.git#egg=dataviso_sequencer

Create new sequence

For complete example see example/vendor_sequences/acme.py for API usage.

1. Create Step:

from dataviso_sequencer.lib.core import Step


class MyFirstStep(Step):
    def run(self, previous_step_data=None, **kwargs):
        # Add some code

    def get_output(self):
        # Return (optionally) some data

2. Create Sequence:

from dataviso_sequencer.lib.core import Sequence


class MyFirstSequence(Sequence):
    def get_flow(self):
        return [MyFirstStep()]

    def run(self):
        for step in self.get_flow():
			step.run()

    def run_step(self, step_key):
        # TODO

3. Register your Sequence (see example/run.py):

from vendor_sequences.example import MyFirstSequence

SEQUENCE_REGISTER = (
	MyFirstSequence,
)

4. Test (run) your Sequence:

cd your/working/directory/...
cd example/
python run.py
Starting:  <class 'vendor_sequences.acme.MyFirstSequence'>

Package tests

Install requirements:

pip install -r requirements.txt --upgrade

and simply use tox:

tox