Migrating Kafka on Azure HDInsight to Confluent Platform

The overall migration is a large migration project that is divided into smaller migrations and responsible individual teams. PTA takes on the tasks of one of these teams with the project roles of analyst, developer and quality manager. In the analysis, an understanding of the data pipelines from a technical and content perspective is built and documented in Confluence, which includes services and applications (building blocks), domain knowledge around Endur and Short on Trading (content), understanding of the solution architecture and understanding of the data structures and data models in physical and conceptual terms. The developer's role focuses on understanding the distributed infrastructure, technical formats such as Avro, JSON, Kafka streams and the possibilities of debugging in end-to-end scenarios. The QA manager examines and formulates relevant error and test scenarios and thus builds a close-knit test strategy. PTA works in close coordination with the customer's internal teams.