Dieses IT-Projekt ist Teil unserer Digitalisierung und Optimierung der IT-Landschaft unserer Kunden. Durch gezielte Maßnahmen fördern wir den technologischen Fortschritt, optimieren systemübergreifende Prozesse und schaffen eine nachhaltige Basis für zukünftige Entwicklungen. Unsere IT-Referenzprojekte dienen als Grundlage zur Orientierung. Sie unterstützen die Wiederverwendbarkeit erprobter Konzepte im Rahmen der Projektumsetzung.
Dies ist eines von 4929 IT-Projekten, die wir erfolgreich mit unseren Kunden abgeschlossen haben.Wobei dürfen wir Sie unterstützen?
Integration of a Hadoop system into the existing classic Business Intelligence (BI) landscape
Kurzbeschreibung
In the context of the project to modernize the business intelligence / data warehouse landscape, a concept for data management, storage and evaluation based on a Hadoop system is required. Among other things, it should be considered how a Hadoop system can be optimally integrated into the customer's existing BI landscape.
Ergänzung
The existing BI infrastructure consisting of a Teradata Enterprise Data Warehouse with ETL routes (Extract, Transform, Load) mapped in Oracle Data Integrator is to be extended by a Hadoop system. This requires concepts for data management, storage and evaluation that differ from classical approaches. This includes the evaluation and selection of: suitable knowledge modules of the Oracle Data Integrator regarding data management; a suitable data format (Avro, CSV, JSON, ORC, Parquet) and compression methods (Snappy, Zlib) regarding data storage; and a suitable SQL engine (Hive/Tez, Presto, Spark) regarding data evaluation.
Fachbeschreibung
The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures. (see http://hadoop.apache.org/)
IT-Projektdaten
- Branchen Logistik
- Fachaufgaben documentation, performance analysis, Retail logistics, system administration
- DV-Aufgaben IT consulting
- Systemumgebungen Business Intelligence, Cloud Computing, Middleware, technical data processing
- Vorgehensmodell customer standard
- Datenbanken Amazon Elastic MapReduce (EMR), Apache Hadoop, Apache Hive, Oracle Data Integrator, Presto, Teradata, Teradata Connector for Hadoop
- Entwicklungs- und Testtool Aqua Data Studio, Teradata Studio
- Standardsoftware und BI Apache Sqoop
Projektbeginn01.11.2017
Kunden, die uns vertrauen
Haben wir Ihr Interesse geweckt?
