Dieses IT-Projekt ist Teil unserer Digitalisierung und Optimierung der IT-Landschaft unserer Kunden. Durch gezielte Maßnahmen fördern wir den technologischen Fortschritt, optimieren systemübergreifende Prozesse und schaffen eine nachhaltige Basis für zukünftige Entwicklungen. Unsere IT-Referenzprojekte dienen als Grundlage zur Orientierung. Sie unterstützen die Wiederverwendbarkeit erprobter Konzepte im Rahmen der Projektumsetzung.
Dies ist eines von 4929 IT-Projekten, die wir erfolgreich mit unseren Kunden abgeschlossen haben.Wobei dürfen wir Sie unterstützen?
Evaluation of Snowflake as an Enterprise Cloud Data Warehouse (DWH)
Projektdauer: 3 Monate
Kurzbeschreibung
The aim of the project is to evaluate Snowflake as a candidate for the replacement of an Enterprise Data Warehouse (EDWH) based on Teradata. In addition to performance analyses compared to the existing Teradata-based DWH, the integration into the customer's system landscape is of particular interest. A near-real-time data management is evaluated according to the change data capture principle, a comprehensive data import from the AWS S3 storage, a data transformation including analytical functions and Python as well as a reporting on detail data level of several billion data records with a frontend tool. The PTA supports the definition of a catalogue of criteria, the provision and import of representative test data and develops scenarios for reporting. A performance analysis is also carried out.
Ergänzung
The connection of the source systems to the Enterprise DWH takes place primarily according to the Change Data Capture principle with the tool HVR (High Volume Replication). For source systems with large amounts of data and frequent data changes, an efficient method (Burst Mode) is tested, which works in conjunction with the AWS S3 Storage. In addition, an efficient data import from the AWS S3 storage is evaluated directly, in which several files are loaded simultaneously into tables. On the test data, the PTA performs a performance benchmark to compare the reporting response times with the existing DWH. With both horizontal and vertical scaling of Snowflake Warehouse compute performance, response time is measured based on user behavior. In addition to tool-based access with Tableau, multi-user access is simulated using a Snoflake Connector for Python. The PTA prepares the results of the benchmark for a decision basis.
IT-Projektdaten
- Branchen Logistik
- Fachaufgaben Big Data, business intelligence, data warehouse, ETL, performance analysis, Retail logistics
- DV-Aufgaben Data Warehouse
- Systemumgebungen Business Intelligence, Cloud Computing
- Vorgehensmodell agile software development
- Datenbanken Oracle Data Integrator, Snowflake
- Entwicklungs- und Testtool Aqua Data Studio
- Standardsoftware und BI MS PowerBI, Tableau Desktop
- Middleware und Frameworks HVR
Projektzeitraum01.05.2019 - 31.07.2019
Kunden, die uns vertrauen
Haben wir Ihr Interesse geweckt?
