Senior Software Engineer, Data Platform
Senior Software Engineer, Data Platform
Requirements for This Role:
- Experience: 7+ years working with modern data technologies and/or building data-intensive distributed systems.
- Programming Skills: Expert-level proficiency in Java/Scala or Python, with a proven ability to write high-quality, maintainable code.
- Database and Scripting: Strong knowledge of SQL and Bash.
- Cloud Technologies: Experience in leveraging and building cloud-native technologies for scalable data processing.
- Data Systems: Previous experience with both batch and streaming systems, understanding their limitations and challenges.
- Data Processing Technologies: Familiarity with a range of technologies such as Flink, Spark, Polars, Dask, etc.
- Data Storage Solutions: Knowledge of various storage technologies, including S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, etc.
- Data Formats and Serialization: Experience with multiple data formats and serialization systems like Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, etc.
- ETL Pipelines: Proven track record of managing complex data ETL pipelines using tools like Kubernetes, Argo Workflows, Airflow, Prefect, Dagster, etc.
- Schema Governance: Prior experience dealing with schema governance and schema evolution.
- Data Quality Control: Experience in developing data quality control processes to detect and address data gaps or inaccuracies.
- Mentorship: A desire to mentor less experienced team members and promote best practices and high standards in code quality.
- Problem-Solving: Strong technical problem-solving abilities.
- Agile Environment: Proven capability to work in an agile, fast-paced environment, prioritize multiple tasks and projects, and handle the demands of a trading environment efficiently.
FAQs
Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your resume and details on file so when we see similar roles or see skillsets that drive growth in organizations, we will always reach out to discuss opportunities.
Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.
We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business.
That's why we recommend registering your resume so you can be considered for roles that have yet to be created.
Yes, we help with resume and interview preparation. From customized support on how to optimize your resume to interview preparation and compensation negotiations, we advocate for you throughout your next career move.