Beam - pyodbc Connector

Beam - pyodbc Connector is an io connector of Apache Beam to access databases which are ODBC complaint.

Installation

pip install beam-pyodbc-connector

Getting Started

• Read From Database

from beam-pyodbc.connector import splitters
from beam-pyodbc.connector.io import ReadFromDB


read_from_db = ReadFromDB(
        query="SELECT * FROM test_db.tests;",
        host="localhost",
        database="test_db",
        user="test",
        password="test",
        port=3306,
        splitter=splitters.NoSplitter()  # you can select how to split query from splitters
)

• Write To Database

from beam-pyodbc.connector.io import WriteToDB


write_to_db = WriteToDB(
        host="localhost",
        database="test_db",
        table="tests",
        user="test",
        password="test",
        port=3306,
        batch_size=1000,
)

License

MIT License. Please refer to the LICENSE, for further details.