Near-time DWH with integration of many data sources
Near-time DWH with integration of many data sources May 2014 – June 2017 Further development and optimization of an import framework configurable via metadata Development of a generator for creating DDL and import definitions based on templates for the rapid integration of new sources or changes to sources Integration of several thousand sources (DBs, CSV, […]
Interface between campaign tool & email providers
Interface between campaign tool & email providers Jul. 2020 – Nov. 2020 Reverse engineering of the old interface based on C# for the purpose of creating requirements documentation. Lean reimplementation based on Perl and Sqlite Easier configuration through YAML Faster adaptation to changes in business or technical requirements High robustness with low maintenance effort Extensions […]
DWH setup in Hadoop
DWH setup in Hadoop Apr. 2019 – Dec. 2019 Setting up a DWH in a Hadoop environment Requirements analysis ETL development with a Spark framework and Exasol Improvement of the provisioning processes Modeling with DataVault 2.0
Migration online ticket system – En
Migration online ticket system Nov 2020 – Jan 2022 Creation of a database model to create the basis for the migration objects (Oracle) Development of integration processes for various sources (APIs, database) JSON objects for transfer via interface APIs (Python) a framework for high-performance and reliable data exchange via the APIs using threads and multiprocessors […]