Website Collaboration.Ai
Connect the right people around the right ideas.
Collaboration.ai is seeking a highly skilled and passionate Senior Backend Engineer with expertise in data engineering and AI/LLM integration to play a key role in developing our core backend systems and data platform. This remote, full-time position offers an exceptional opportunity to architect and build scalable, robust, and secure backend services, data pipelines, and APIs that power our intelligent applications and agentic workflows.
As a foundational member of our backend and data engineering team, you will design solutions for raw data capture, web scraping, data processing, transformation, and storage, directly contributing to our cutting-edge AI/LLM systems. Your expertise in Python, data engineering principles, and backend architectures will be essential as we scale our platform.
Responsibilities:
- Architect, design, develop, and maintain high-performance backend systems, microservices, and robust data pipelines with a focus on data and AI.
- Lead the development of solutions for raw data capture, web scraping, data processing, cleaning, and transformation for LLM/Agent consumption.
- Design and implement APIs for data access, processing, and integration with frontend applications and AI/LLM systems.
- Contribute to the overall architecture and scalability of our backend infrastructure and data platform.
- Design, build, and optimize data pipelines for efficient data ingestion, processing, and storage.
- Work with various data storage technologies, including RDBMS, NoSQL databases, GraphDBs, and vector/RAG storage solutions.
- Implement data quality checks and monitoring.
- Optimize data pipelines for performance, scalability, and cost-effectiveness.
- Develop and maintain backend services that integrate with AI/LLM models and agentic frameworks.
- Design APIs and data flows to support the deployment, monitoring, and scaling of AI/LLM applications.
- Collaborate with AI/ML engineers to optimize data pipelines and infrastructure for AI workloads.
- Implement robust security best practices for backend systems and data handling.
- Collaborate with DevOps and security teams to ensure compliance with relevant standards (e.g., NIST frameworks, SOC2).
- Implement data access controls and security measures.
- Mentor junior engineers and contribute to code reviews and architectural discussions.
- Collaborate effectively with cross-functional teams in an agile environment.
- Champion best practices in backend development, data engineering, and security.
Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 7+ years of professional experience in backend development, proficiency in Python, and experience with strongly-typed languages (e.g., Kotlin, Java, Go, Rust).
- Extensive experience in data engineering principles and building robust data pipelines.
- Proven expertise in designing and developing scalable and secure backend systems and microservices.
- Familiarity with containerization (Docker, Kubernetes) and modern deployment practices.
- Proficiency with multiple persistence technologies (RDBMS, NoSQL, GraphDBs, vector/RAG storage).
- Solid understanding of cloud platforms (AWS, Azure, or GCP).
Preferred Qualifications:
- Deep experience building and deploying backend systems in regulated environments requiring NIST-53 compliance.
- Strong background in AI/LLM system integrations and agentic software development.
- Experience with web scraping technologies and data extraction techniques.
- Proven leadership in architecting enterprise-grade backend and data solutions.
- Experience with data streaming technologies (e.g., Kafka, Kinesis).
- Advanced degree in Computer Science, Data Science, or a related field.
- Remote, with preference for candidates in the Central Time Zone.