Loading…
Tuesday November 12, 2024 11:00am - 11:50am PST
Mohammed Amine Garmes, Amadeus, Principal Data Engineer
Liam Mulhall, Amadeus, Innovation Leader

The Amadeus Hexadata Platform (AHP) is an advanced suite of capabilities for constructing and managing multiple End-to-End (E2E) big data pipelines.
- Processes approximately 2 billion transactions daily.
- Fully migrated from on-premise to Azure Cloud.
- Data size 10PB.
Data Integration:
- Integrates data from around 6,000 servers across various Amadeus divisions and external clients.
- 90% of data handled via Kafka, hosted on Azure or within a private data center.
- Utilizes Mirror Maker to replicate data across four Kafka clusters.
- Utilizes KafkaConnectors to stream files to Kafka
Technologies Used:
KStreams, Databricks, Kafka Connectors, Airflow, Internal Framework
Additional Capabilities:
Operational on OpenShift. (4000 Pods)
ElasticSearch
MLOPS pipeline : CICDCD for ML models on the platform in Azure. - on-going -
Key Benefits:
Provides scalable, reliable, and efficient big data processing and analytics solutions.
Speakers
avatar for Mohammed Amine Garmes

Mohammed Amine Garmes

Principal Data Engineer, Amadeus
As a Principal Data Engineer with over nine years of experience at Amadeus, I specialize in designing and optimizing the company's Big Data platform. I lead complex data engineering projects, leveraging my expertise to ensure scalable, efficient, and high-performance data processing... Read More →
avatar for Liam Mulhall

Liam Mulhall

Innovation Leader, Amadeus
A highly motivated and results-oriented technical leader with over 25 years of experience in delivering complex software solutions. My expertise lies in building scalable, secure, and real-time systems across various industries - all with a centralized view around 'achieving the best... Read More →
Tuesday November 12, 2024 11:00am - 11:50am PST
VIRTUAL CloudX -- Main Stage
Feedback form is now closed.

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Share Modal

Share this link via

Or copy link