Тази обява е публикувана само в DEV.BG Jobs: Преглеждаме значимите български сайтове за обяви за работа (с поне 400 IT обяви за работа). Тази обява не е публикувана в нито един от тях.
Our client is a New York City-based FinTech startup that is building a trading and risk software platform for the investment banking industry to sell as a service.
We’re looking for a BigData engineer who will work on building new parts of scalable DataLake and expand the existing ones based on cutting edge technologies (Spark, Hadoop, DataBrix). The DataLake is used by quantum analysts for ad hoc queries and by data scientists to build models for predicting investment opportunities. Data enters the DataLake using ETL ingestion pipelines implemented with Apached Airflow. The specialist will join a distributed team on DataArt’s side that consists of 30 people from Ukraine, Russia, Poland, and the US.
Must have
Excellent knowledge of the general principles of Big Data
Experience with distributed systems
Excellent knowledge of Spark (Core, SQL, Streaming)
Excellent knowledge of Java, Scala, or Python
Experience with AWS or other cloud providers
Experience with BigData solutions
Good spoken English
Would be a plus
Knowledge of Kafka
Knowledge of Apache Airflow
Infrastructure management (DevOps)
Knowledge of PySpark
Knowledge of Databricks
Experience with Kubernetes
Learn more about our policy of equal opportunities in employment