Research Scientist Intern
xpengmotors · Santa Clara, CA
Posted about 2 months ago
Apply in seconds with Jobply
One-click apply on Workday, Greenhouse, Lever & 50+ ATS systems
Skills
Vision-Language-Action (VLA) Foundation Modellarge-scale multi-modal architecturesvision–language–action transformersautonomous drivingAImachine learningmodelingalgorithmic developmentresearchdeep learning
Job description
<div data-lark-html-role="root">
<div data-page-id="PeZsdhFjdoz8PHx781IccZNinld" data-lark-html-role="root" data-docx-has-block-data="false">
<div class="ace-line ace-line old-record-id-GonUdOmdKoWPaDxeOFrcyALxnTc">
<div data-page-id="PeZsdhFjdoz8PHx781IccZNinld" data-lark-html-role="root" data-docx-has-block-data="false">
<div class="ace-line ace-line old-record-id-GonUdOmdKoWPaDxeOFrcyALxnTc"><strong>XPENG</strong> is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing (eVTOL) aircraft, and robotics. With a strong focus on intelligent mobility, XPENG is dedicated to reshaping the future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.</div>
<div class="ace-line ace-line old-record-id-Zu4QduYTGoYc7BxI9tEcvw99nve"> </div>
<div class="ace-line ace-line old-record-id-EbyJdwLRpoKxxtxy4Dvc6gdAn2b">
<div data-page-id="MLCOdotR1oSsxwxp9gRcD1pDnwc" data-lark-html-role="root" data-docx-has-block-data="false">
<h4 class="heading-4 ace-line old-record-id-NX3LdgnbaoosVGxS1gmc4kaNnyd"><strong>About the Role</strong></h4>
<div class="ace-line ace-line old-record-id-EvbPds3CGo06KFxvuywci7DKnJg">We are actively seeking a full-time <strong>Research Scientist Intern</strong> to drive the modeling and algorithmic development of XPENG’s next-generation <strong>Vision-Language-Action (VLA) Foundation Model</strong> — the core brain that powers our end-to-end autonomous driving systems.</div>
<div class="ace-line ace-line old-record-id-EvbPds3CGo06KFxvuywci7DKnJg"> </div>
<div class="ace-line ace-line old-record-id-NnWgdedBeo4bylxcOoZcTW0snuN">You will work closely with world-class researchers, perception and planning engineers, and infrastructure experts to design, train, and deploy large-scale multi-modal models that unify vision, language, and control. Your work will directly shape the intelligence that enables XPENG’s future L3/L4 autonomous driving products.</div>
<h4 class="heading-4 ace-line old-record-id-APAAdolhYoV05GxAnPccxMlxnGh"><strong>Key Responsibilities</strong></h4>
<ul class="list-bullet1">
<li class="ace-line ace-line old-record-id-PztBdaWpZoxxaoxLlW5c3891ndX" data-list="bullet">
<div>Conduct research on designing and implementing <strong>large-scale multi-modal architectures</strong> (e.g., vision–language–action transformers) for end-to-end autonomous driving.</div>
</li>
<li class="ace-line ace-line old-record-id-FFvgdwAgGoCnuLxps3IcsKyGn5d" data-list="bullet">
<div>Design and integrate <strong>cross-modal alignment</strong> (e.g., visual grounding, temporal reasoning, policy distillation, imitation and reinforcement learning) to improve model interpretability and action quality.</div>
</li>
<li class="ace-line ace-line old-record-id-CGNfdcbnpoa9zNxHgnpcWPjtnxb" data-list="bullet">
<div>Closely collaborate with researchers and engineers across the modeling and infrastructure team.</div>
</li>
<li class="ace-line ace-line old-record-id-UvBvd9tzUoOfCLxDINgcwweKnRh" data-list="bullet">
<div>Contribute to top-tier AI/CV/ML conferences publications and present research findings.</div>
</li>
</ul>
<h4 class="heading-4 ace-line old-record-id-BhLUdS48ooLKdexuYZxcPwStnKg"><strong>Minimum Qualifications</strong></h4>
<ul class="list-bullet1">
<li class="ace-line ace-line old-record-id-IESUd2o6coCezYxljFzc4GE6ndf" data-list="bullet">
<div>Currently enrolled in the Master/Ph.D program in <strong>Computer Science, Electrical/Computer Engineering, or related field</strong>, with<strong> </strong>the specialization in the CV/NLP/ML.</div>
</li>
<li class="ace-line ace-line old-record-id-Sp81d3k2UonmjixJlKwcldE5nGg" data-list="bullet">
<div>Experience in <strong>multi-modal modeling</strong> (vision, language, or planning), with deep understanding of <strong>representation learning, temporal modeling</strong>, and <strong>reinforcement learning</strong> techniques.</div>
</li>
<li class="ace-line ace-line old-record-id-Us2rdvlAhoH29qxLFotcvMYqn9c" data-list="bullet">
<div>Strong proficiency in <strong>PyTorch</strong> and modern transformer-based model design.</div>
</li>
</ul>
<h4 class="heading-4 ace-line old-record-id-ITrBdRCIroOdP2xTeigcri0mnGe"><strong>Preferred Qualifications</strong></h4>
<ul class="list-bullet1">
<li class="ace-line ace-line old-record-id-IJikdtrNRoIfnlxixlscRFZmnmc" data-list="bullet">
<div>Publication record in top-tier AI conferences (CVPR, ICCV, ECCV, NeurIPS, ICLR, ICML, etc).</div>
</li>
<li class="ace-line ace-line old-record-id-UrXUdS5Koota0NxreUKciK1fnRd" data-list="bullet">
<div>Prior experience building <strong>foundation or end-to-end driving models</strong>, or <strong>LLM</strong><strong>/VLM architectures</strong> (e.g., ViT, Flamingo, BEVFormer, RT-2, or GRPO-style policies).</div>
</li>
<li class="ace-line ace-line old-record-id-RXBLddfjrotVyNx0MQVc9cpNnNf" data-list="bullet">
<div>Knowledge of <strong>RLHF/DPO/GRPO</strong>, <strong>trajectory prediction</strong>, or <strong>policy learning</strong> for control tasks.</div>
</li>
<li class="ace-line ace-line old-record-id-T4mwdNnyoo5gEHxuDqnc1efVnnf" data-list="bullet">
<div>Familiarity with <strong>distributed training</strong> (DDP, FSDP) and large-batch optimization.</div>
</li>
</ul>
<h4 class="heading-4 ace-line old-record-id-AfK2dgFEMo3bM6xW8uJcNmbMnnd"><strong>What We Offer</strong></h4>
<ul class="list-bullet1">
<li class="ace-line ace-line old-record-id-EdFAd21h2oLE9yxcBf3cdr8dnEh" data-list="bullet">
<div>A collaborative, research-driven environment with access to <strong>massive real-world data</strong> and <strong>industry-scale compute</strong>.</div>
</li>
<li class="ace-line ace-line old-record-id-Jiy5dpF1TorYLZxA2qDcbsN0nCb" data-list="bullet">
<div>Opportunity to work with <strong>top-tier researchers and engineers</strong> advancing the frontier of foundation models for autonomous driving.</div>
</li>
<li class="ace-line ace-line old-record-id-QMIKdraoXotpaux2025cWcmSn3g" data-list="bullet">
<div>Direct impact on the next generation of <strong>intelligent mobility systems</strong>.</div>
</li>
<li class="ace-line ace-line old-record-id-RPVEdKrvCoK3sTx0JuycQWn1nlh" data-list="bullet">
<div>Comprehensive benefits, meals, and team-building activities.</div>
</li>
</ul>
</div>
</div>
<div class="ace-line ace-line old-record-id-ExDodVceNonouCxJFFAcjryTnVh"><strong>What do we provide:</strong></div>
<ul class="list-bullet1">
<li class="ace-line ace-line old-record-id-FRKcdsexnoXrvcxUxfZcGQQZnQc" data-list="bullet">
<div>A fun, supportive and engaging environment</div>
</li>
<li class="ace-line ace-line old-record-id-DWcRdmluHof4vuxTWYQcS3gxn3c" data-list="bullet">
<div>Infrastructures and computational resources to support your work.</div>
</li>
<li class="ace-line ace-line old-record-id-DD3zd1rJ5oF3oJxu5fvc3Lx7nsg" data-list="bullet">
<div>Opportunity to work on cutting edge technologies with the top talents in the field.</div>
</li>
<li class="ace-line ace-line old-record-id-Tmabd2QKloWZEWxa8sbcMS9onkg" data-list="bullet">
<div>Opportunity to make significant impact on the transportation revolution by the means of advancing autonomous driving</div>
</li>
<li class="ace-line ace-line old-record-id-OuLAdFrQPoJ76UxdOkgcfnponSf" data-list="bullet">
<div>Competitive compensation package</div>
</li>
<li class="ace-line ace-line old-record-id-YVM7duy6eowfGsx4pIKcX5DlnTg" data-list="bullet">
<div>Snacks, lunches, dinners, and fun activities</div>
</li>
</ul>
<div class="ace-line ace-line old-record-id-KTmbdkVdxoQxl6xKwZ5cOC0Qnvg"> </div>
<div class="ace-line ace-line old-record-id-QVuHdEbaPoIdCXxnPZycBc0gnBd">We are an Equal Opportunity Employer. It is our policy to provide equal employment opportunities to all qualified persons without regard to race, age, color, sex, sexual orientation, religion, national origin, disability, veteran status or marital status or any other prescribed category set forth in federal or state regulations.</div>
</div>
</div>
</div>
</div>
Stop filling out the same form 100 times.
Install the free Jobply Chrome extension and auto-apply to Research Scientist Intern and 300,000+ other live jobs across Workday, Greenhouse, Lever, and 50+ other ATS systems.
Apply with Jobply — Free✓ Free forever✓ No credit card✓ 4.8★ from 12k+ users