We are looking for a Senior Full Stack Engineer to collaborate directly with our CTO and the product team. If you're someone who thrives in the fast-paced environment of a small team and is excited about playing a pivotal role in shaping a product of an early-stage startup, then this opportunity is made for you.dlt is an open-source library that automatically creates datasets out of messy, unstructured data sources. You can use the library to move data from about anywhere into most of well-known SQL and vector stores, data lakes, storage buckets, or local engines like DuckDB. It automates many cumbersome data engineering tasks and can be handled by anyone who knows Python. More details in this Hacker News article.dltHub is based in Berlin and New York City. It was founded by data and machine learning veterans. We are backed by Dig Ventures and many technical founders from companies such as Hugging Face, Instana, Matillion, Miro, and Rasa.Your Task and Responsibilities:Design and implement our platform web application using Fast API, Next.js, and a bunch of various database and streaming backendsOffer support to our platform users in SlackMaintain the open source project with the team (e.g., review PRs, resolve issues, talk with community contributors, etc.)Contribute to the dlt core, including code, tests, and documentationRequirementsWho You Are:You really like Python and are fluent in writing Python code (e.g., Python typing, unit testing, writing docstrings, etc.)Proven experience with Python web frameworks, such as FastAPI or Django, as well as the OpenAPI specificationsProven experience with frontend technologies, such as React and Next.js.Experience with database modeling and Python ORMs, such as SQLAlchemy.You have a degree in computer science, data science, or other equivalent experienceYou are familiar with GitHub workflows (e.g., pull requests, code reviews, CI/CD services, etc.)You are based in Berlin and willing to work in our office regularlyNice to Have:Experience with DevOps (e.g., CI systems like GitHub Actions, Docker, Kubernetes, AWS/GCP/DigitalOcean, etc.)Experience with OLAP Databases, such as ClickHouse, Pinot, or DruidExperience with machine learning (e.g., the toolset, the workflows, practical applications, etc.)BenefitsWe are an office-first company but give you plenty of opportunities for deep work and work from home. We prioritize automation, starting with our own tasks before extending them to others.Dedicated "no meeting days" to help the team focus on their most impactful workBuilding connections with the team in person is crucial, so we host regular team lunches and eventsAs we work often from the Berlin office, we cover your public transportation ticketWe offer Urban Sports Club membership We are deeply committed to your personal and professional growth, so we have an annual budget for learning and development.Über das Unternehmen:dltHub

Senior Data Engineer (F/M/D) - Berlin

Vestiaire Collective, Berlin

Vestiaire Collective is the leading global online marketplace for desirable pre-loved fashion. Our mission is to transform the fashion industry for a more sustainable future by empowering our community to promote the circular fashion movement. Vestiaire was founded in 2009 and is headquartered in Paris with offices in London, Berlin, New York, Singapore and Hong Kong and warehouses in Tourcoing (France), Crawley (UK), Hong Kong and New York. We currently have a diverse global team of 700 employees representing over 50 nationalities. Our values are community, activism, transparency, dedication and greatness. We are proud to be a BCorp.Senior Data Engineer (F/M/D)Full-time, Permanent role based in BerlinAbout the roleVestiaire Collective is hiring a Senior Data Engineer on our data platform team, to play a crucial role in developing and enhancing our data infrastructure, driving Vestiaire Collective's mission towards a sustainable fashion industry. What you'll doReal-Time Data ProcessingCreate real-time data processing applications, leveraging Kafka for timely data availability.Ensure high throughput and low latency in data processing/service.Data Platform Architecture:Design and evolve our data platform's architecture for scalable, efficient data processing and analytics.Participate in strategic planning for long-term alignment with business goalsData Integration and ModelingImplement robust, scalable data integration strategies.Optimize data models for efficient storage, retrieval, and analytics.Building ML Platform EcosystemCollaboratively develop a scalable, reliable ML platform, focusing on model serving, training, and essential MLOps features.Prioritize efficiency, automation, and best practices in MLOps.Workflow AutomationDevelop automated solutions to enhance data operations.Utilize Apache Airflow for effective data workflow management.Continuous Learning and ImprovementStay abreast of the latest data engineering trends and technologies.Foster a culture of continuous learning and knowledge sharing.Who you areConcrete knowledge on Real-Time data processing (Apache Spark/Flink, Apache Beam)Required SkillsPythonExpert in clean, efficient Python coding; proficient with data libraries and web frameworksSkilled in asynchronous programming.SQL: Strong in SQL syntax and query optimization.Kafka:Proficient in Kafka architecture and stream processing.ML Deployment / Optimization: Experienced in ML model deployment and MLOps principles.Required ToolingsSpark/Flink (or any other framework): Experienced in distributed data processingApache Airflow: Expertise in workflow management.FastAPI/Robyn: Skilled in FastAPI/Robyn development and features.Git:Advanced knowledge in version control and CI/CD integration.Cloud Services: AWS or similar cloud experience.Data Visualization Tools: Proficient in tools like Streamlit.Monitoring and Logging Tools: Experienced with tools like DataDog, Prometheus, and Grafana.Nice to have skillsTerraform/Ansible: Skills in infrastructure automation.Golang: Experience in Go programming and its ecosystem.DBT: Proficient in DBT for data warehousing.What we offerA meaningful job with an impact on the way people consume fashion and promote sustainabilityFlexible work possibilitiesThe opportunity to do career-defining work in a fast-growing French-born scale upThe possibility to work as part of a globally diverse team with more than 50 nationalities Two days to help Project - reinforcing your activist journey and volunteer for an associationSignificant investment in your learning and growthCompetitive compensation and benefits packageAs full member of our entrepreneurial project, you will be eligible to free sharesVestiaire Collective is an equal opportunities employer Standort Vestiaire Collective, Berlin

Zeig mehr