(Master thesis) Building of a real-time data pipeline for collection, enrichment and visualization of network flows in a multi-cloud context

While the cloud may seem abstract, it relies on servers interconnected by complex, multi-layered and virtualized network infrastructures. Visualizing flows is a real challenge and understanding what information is flowing, along which path and in which context is crucial for both operational and security issues.

In this internship, you will join the ELCA Cloud Services Network team. Supported by the team, you will build a data pipeline to gather, enrich, store and visualize network flows. You will work on physical devices as well as several network products of major cloud platforms (Azure, AWS). You will specify, architect and implement this system, based on opensource tools. Automation through dev ops practices will be at the heart of your work. Your analytical skills will also be an important asset to extract key performance indicators from the data, build dashboards and trigger alerts via our monitoring system.

Objectives:

• Understand the technical perimeter, its specificities and its stakes
• Build the system specifications from the imposed requirements
• Architect the data pipeline according to specifications and requirements
• Implement the system in accordance with the company's dev ops practices
• Define KPIs from the data collected to build dashboards
• Additionally, work with the monitoring team to trigger alerts based on collected data and KPIs