[Remote] Software Engineer, Systems ML

Note: The job is a remote job and is open to candidates in USA. Meta is hiring a Software Engineer for its Systems ML Engineering team. The role builds and optimizes large-scale machine learning infrastructure, including training and inference systems, performance-critical components, and reliable ML serving solutions.


Responsibilities

  • Design, build, and optimize large-scale ML training and inference systems, including distributed computing frameworks and hardware-accelerated pipelines
  • Develop and maintain high-performance ML infrastructure components in C++ and Python, ensuring reliability, scalability, and low-latency execution
  • Identify and resolve performance bottlenecks across the ML stack using profiling, instrumentation, and benchmarking tools
  • Architect and evaluate trade-offs in ML system design, including memory bandwidth, compute utilization, and I/O throughput
  • Partner with research and product teams to translate ML model requirements into efficient infrastructure solutions
  • Define and track system-level metrics and service level objectives to maintain production reliability of ML serving systems
  • Lead technical design reviews and contribute to engineering standards for ML systems across the organization
  • Mentor other engineers on ML infrastructure best practices, debugging methodologies, and performance optimization techniques
  • Drive adoption of AI-augmented development workflows to expand engineering productivity and broaden the scope of deliverables
  • Contribute to staged rollout strategies using feature flagging and experimentation frameworks to safely deploy ML system changes

Skills

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 6+ years of experience in software engineering with a focus on machine learning systems, AI infrastructure, or high-performance computing
  • Experience developing and optimizing ML training or inference pipelines using frameworks such as PyTorch, TensorFlow, or equivalent
  • Experience with distributed computing architectures and large-scale systems design for ML workloads
  • Experience programming in C++ and Python for performance-critical systems
  • Experience using profiling and performance analysis tools to identify and resolve bottlenecks in ML or compute-intensive systems
  • Experience optimizing large-scale ranking and recommendation model inference on AI accelerator hardware
  • Experience with hardware-software co-design, including numerics optimization and SIMD or vectorization techniques
  • Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
  • Experience with GPU programming using CUDA, ROCm, or equivalent hardware accelerator kernel development
  • Experience with ML compiler technologies such as MLIR, LLVM, TVM, XLA, or IREE
  • Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
  • Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)

Benefits

  • Bonus
  • Equity

Company Overview

  • Meta is a social technology company that enables people to connect, find communities, and grow businesses. It was founded in 2004, and is headquartered in Menlo Park, California, USA, with a workforce of 10001+ employees. Its website is

  • Company H1B Sponsorship

  • Meta has a track record of offering H1B sponsorships, with 5145 in 2026, 6419 in 2025, 5944 in 2024, 3874 in 2023, 5237 in 2022, 7 in 2021, 10 in 2020. Please note that this does not guarantee sponsorship for this specific role.

  • Back to blog

    Other Jobs To Apply

    No other job posts for this day.

    Common Interview Questions And Answers

    1. HOW DO YOU PLAN YOUR DAY?

    This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

    2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

    When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

    3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

    Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

    4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

    With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

    5. HOW DO YOU PROCESS INFORMATION?

    Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

    6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

    Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

    7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

    Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

    8. HOW TO PRIORITIZE WORK?

    The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

    9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

    Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

    10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

    This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...