The Future Of AI In Urban Autonomous Mobility

On my recent trip to San Francisco, I had the chance to experience a Waymo self-driving car, and it felt like stepping into the future. No driver. No human intervention. Just AI quietly taking charge of something we’ve always associated with human reflexes and instincts. At SilverFern Digital we keep a close eye on such breakthrough experiences- studying how products like these function, helps us absorb key learnings and put them to use in our AI-first products and everyday design practice. We broke it down: how is AI able to do this so seamlessly? 🔹 Studying Patterns: Waymo cars don’t just "react." They’ve been trained on millions of miles of driving data, learning the tiniest nuances of human and environmental behavior on the road. 🔹 Building Intelligent Systems: From perception (seeing pedestrians, cyclists, traffic signals) to prediction (anticipating how others might move), every decision is powered by a layered AI brain working in real time. 🔹 Cohesive UX & Trust: The magic isn’t just in the AI. It’s in how that intelligence is communicated back to passengers. Clear displays, intuitive cues, and subtle motions help you trust the car. That’s where UX becomes just as important as AI. This intersection of AI, UX, and automotive design is reshaping not just how cars move, but how we move, work, and live. For me, the ride wasn’t about tech; it was about how natural it felt to let go, to trust, and to experience safety redefined by design. The future of transportation isn’t just autonomous. It’s empathetic, data-driven, and deeply human-centered. As we build more AI-first products, these innovations inspire us to design new-age automotive experiences that push the boundaries of design, technology, and trust. What are your automotive transformation experiences? #AI #UXDesign #FutureOfMobility #SilverfernDesign

The Future of Autonomous Vehicles: How GenAI is Accelerating Innovation . The future of fully autonomous vehicles (AVs) is accelerating, thanks to the transformative power of generative AI (GenAI). As highlighted in recent insights from CB Insights, #GenAI is breaking down key barriers that have long delayed the widespread adoption of self-driving #cars . (1) Enhancing In-Car Communication One major advancement is the enhancement of in-car voice assistants. GenAI-powered LLMs are bridging the communication gap between passengers and self-driving cars, evolving from pre-recorded commands to hyper-personalized, natural conversations. Imagine saying, “Let’s go pick up food at my favorite restaurant,” and your car seamlessly understanding and acting on it—a future that’s already within reach. (2) Reducing Training Costs Training costs are also being slashed through GenAI-simulated environments. These virtual settings allow AV systems to rack up millions of miles driven in a controlled, cost-effective manner, improving safety testing without the need for extensive real-world trials. This innovation is a game-changer for automakers aiming to refine their technology efficiently. (3) Improving Safety and Transparency Safety and transparency are critical for gaining regulatory trust, and GenAI is stepping up here too. By providing clear explanations for driving decisions—moving away from the “black box” approach—LLMs enhance accountability. For instance, a car detecting a pedestrian and explaining its stop decision in plain language builds confidence among regulators and passengers alike. (4) Strategic Partnerships To stay competitive, automakers must partner with automotive AI chip manufacturers capable of supporting local LLM processing. Factors like inference time, energy efficiency, and durability will be key in selecting the right technology partners. Meanwhile, car insurance providers are adapting by developing new risk assessment models, including provisions for cybersecurity threats, potentially collaborating with automotive cybersecurity firms. (5) Transforming Cars into Digital Platforms Looking ahead, GenAI is turning cars into digital platforms with agentic AI features. This opens doors for automakers and AV providers to team up with AI agent developers, creating smarter, more interactive vehicles. The UK AI #startup PhysicsX, nearing a $1 billion valuation, exemplifies this trend, developing advanced AI tools for automotive and #aerospace sectors that could further propel AV #innovation . EmpowerEdge Ventures

🎇 On National Day, I went for a leisurely drive in San Francisco and ended up "stress-testing" a Waymo self-driving car on the road. 🚗 As an autonomous driving practitioner, who wouldn't be curious about the real-time robustness of the cutting-edge Waymo One driving system? While cruising downtown, I accidentally noticed a Waymo car tailgating me. While this isn't unusual for SF citizens, a wild, "evil" idea suddenly hit me: Why not directly "adversarially attack" the world's autonomous driving status quo? I executed an unexpected maneuver—suddenly reversing—to see how it would react. 🌟 The response was stellar! At the moment I reversed, Waymo One honked instantly—quicker than any human could—activated its hazard lights, and backed away to maintain a safe distance. This reckless move on my part served as an edge case to test the algorithm's robustness under extreme conditions and, potentially, could be a challenging training sample to enhance Waymo's future autonomous systems. 💫 Thrilled to personally experience how current cutting-edge autonomous algorithms handle rare driving behaviors—and how stable and safe Level 4 autonomy is in dealing with diverse scenarios. However, it also prompted deep reflection as an AI researcher in this field: 🤔 In an industry with little room for error, how can we ultimately avoid or minimize issues that AI fails to handle? 💡 I believe two research directions are particularly promising for achieving Level 5 level autonomy in future mobility systems: - 1️⃣ Development and deployment of vehicle-to-everything (V2X) cooperative systems (including V2V, V2I, V2P, etc). Our initial studies (e.g., V2X-ViT, ECCV'2022 arxiv.org/abs/2203.10638) show that in scenarios with severe occlusions or noise, such cooperative systems can significantly enhance the robustness of perception systems, thereby eventually improving traffic safety. - 2️⃣ Adversarial scenarios generation (including Sim-to-Real, generative modeling). Research done by my colleagues at UCLA (V2XP-ASG, ICRA'2023 https://lnkd.in/gu5nKVHD) shows that adversarial learning techniques can effectively simulate adversarial scenarios, greatly improving model robustness in complex "corner case" situations. Of course, it's often infeasible to collect such collision scenarios. 👨🏫 As a new Assistant Professor of CS at Texas A&M University, I will lead a group focusing on these exciting research directions, which can be a proactive approach to reducing accidents and improving safety for all. 🔥 I look forward to future collaborations with governments, academics, and companies to research and develop data and algorithms that can help enhance the safety of vulnerable road users, especially seniors and children. We envision a people-centered intelligent transportation system in the future. Interested in these topics? Let's connect and discuss further! #AutonomousVehicles #AI #MachineLearning #SmartCities #Transporation #Humanity #Mobility

One of the key challenges of autonomous driving is scalably handling the complexity of driving scenarios, where traffic rules, city environments, and vehicles/pedestrians can interact in a myriad of possible ways. It’s not tractable to create hand-crafted rules that handle every case, so instead we rely on the power of “next frame prediction” in a compact world representation. Here the world representation is semantic segmentation, which captures the essence of what’s happening around a vehicle, and can be stably computed in real-time using Helm.ai’s production grade perception stack. One example of a set of complex scenarios is an intersection with traffic lights, which presents a large number of possibilities that an autonomous vehicle must navigate safely. To tackle this challenge, we added traffic light segmentation and traffic light state to our world model representation, and trained a foundation model to predict what might happen next based on an input sequence of observed segmentations. Our foundation model learned in a fully unsupervised way from real driving data the relationship between traffic light state and what the vehicles/agents on the road should do in various contexts. The result is an ability to forecast a wide variety of scenarios of interaction between traffic lights, intersection geometry, vehicles, and pedestrians that are consistent with potential real world scenarios, including predicting the paths of the ego vehicle and the other agents. In our latest demo, our intent and path prediction models predict 9 seconds into the future using 3 seconds of observed driving data, at 5 frames per second. This prediction capability includes learned human-like driving behaviors, such as intersection navigation, interaction with green and red lights, yielding to oncoming traffic before turning, and keeping a safe distance to other vehicles. Our foundation models are able to predict these future behaviors and plan safe paths by scalable learning from real driving data, without any hand crafted rules nor traditional simulators. Stay tuned for upcoming updates as we continue to expand our unified approach to ADAS through L4 autonomous driving by enriching the world model representation and scaling up our predictive DNNs. #helmai #generativeai #selfdrivingcars #artificialintelligence #ai #autonomousdriving #adas #computervision 

Urban environments are the hardest challenge in ADAS, unpredictable, noisy, and filled with moving targets that don’t follow the script. Helm.AI just dropped a Level 3 perception system designed specifically for that reality, and it’s one of the more impressive moves in autonomy this year. Here’s why it stands out: • 𝗠𝘂𝗹𝘁𝗶𝗺𝗼𝗱𝗮𝗹 𝘀𝗲𝗻𝘀𝗼𝗿 𝗳𝘂𝘀𝗶𝗼𝗻 – Lidar, radar, and cameras working in tight sync, with dynamic calibration and real-time semantic segmentation.   • 𝗘𝗱𝗴𝗲-𝗰𝗮𝘀𝗲 𝗮𝘄𝗮𝗿𝗲𝗻𝗲𝘀𝘀 – The system flags rare or anomalous behaviors and object types, enabling safer fallback strategies. That’s a huge change in environments where “normal” rarely stays that way for long.  • 𝗨𝗿𝗯𝗮𝗻-𝗳𝗶𝗿𝘀𝘁 𝗮𝗿𝗰𝗵𝗶𝘁𝗲𝗰𝘁𝘂𝗿𝗲 – It’s built with complex, congested cityscapes in mind. Cyclists weaving through traffic, occluded intersections, unpredictable pedestrians, this isn’t highway autonomy dressed up for town.  • 𝗥𝗲𝗮𝗹-𝘁𝗶𝗺𝗲 𝗿𝗲𝗮𝘀𝗼𝗻𝗶𝗻𝗴 – We’re not talking about map-reliant heuristics. Helm’s stack adapts on the fly, which is key for scaling to new geographies or handling unexpected conditions. This isn’t about hype. It’s a focused, technical step forward in a part of the stack that doesn’t get enough attention. And if you're building autonomous ground systems of any kind, whether it’s last-mile delivery or robotic platforms, you should absolutely be paying attention. #HelmAI #UrbanAutonomy #Perception #SensorFusion #AutonomousVehicles #Level3 #Robotics

We’re witnessing AI evolve from traditional applications like chatbots and email automation into more complex, high-stakes environments—robotaxis, for instance. Waymo’s integration of Google’s Gemini LLM (Large Language Model) into their self-driving fleet showcases this evolution beautifully. This technology enables their autonomous vehicles to navigate not only streets but complex, real-world scenarios where human-like reasoning and adaptability are essential. The significance here isn’t just in providing a driverless ride. It’s about enhancing safety, expanding mobility access, and redefining how cities manage transportation. Waymo’s robotaxis already deliver over 100,000 rides per week in cities like San Francisco and Phoenix, making it clear that the possibilities for AI go far beyond the screen, delivering tangible value in the physical world. As we consider AI’s future, the real game-changer lies in its application to dynamic, real-world tasks, where it must constantly learn, adapt, and respond. For those of us in AI, our focus must be on ensuring these innovations not only perform but do so safely and ethically—this is how AI will gain the public’s trust and prove its true worth. https://lnkd.in/gWASUxAd

Transportation is the largest employment sector on Earth. Over 1 billion people globally work in roles directly tied to moving people or goods, drivers, operators, couriers, logistics staff. That industry is now facing a seismic shift. At Viva Technology #Paris, I got a hands-on look at Tesla’s new Robotaxi a fully autonomous vehicle with no steering wheel, no pedals, and no driver seat. Just sensors, AI, and minimalism. Here’s what we know: • Tesla plans to unveil the production version on August 8, 2025 • Initial manufacturing is already underway in Texas • Pricing aims to undercut public transport, not just Uber • It will operate via Tesla’s own ride-hailing app • First cities targeted: Austin, San Francisco, Los Angeles • No human driver — full autonomy powered by Tesla's FSD and Dojo AI stack • Global expansion dependent on regulatory approval and real-world test data Tesla isn’t alone. • Waymo (Alphabet) is running autonomous taxis in Phoenix and San Francisco • Cruise (GM) is paused after safety issues but plans to return • Baidu, Inc. and AutoX are already live in parts of China • Uber partnered with Waymo, but their core model faces existential risk The implications are massive: • Driving is the most common job in 29 US states • Millions of Uber, truck, and taxi drivers globally could be replaced • Cities may need to rethink urban infrastructure, licensing, and labor support • Investors will shift focus to platform owners, not fleet operators We’re not talking about a decade from now. We’re talking about product launches this year, pilots already active, and regulators being pushed to move fast. The transportation sector as we know it is approaching a turning point. Are we ready? #AutonomousVehicles #TeslaRobotaxi #FutureOfWork #TransportationDisruption #MobilityTech #AIandJobs #Tesla #Waymo #Cruise #UberFuture #DigitalTransformation #AIInnovation

Regardless of what side of the AI debate you find yourself. Truth is, AI is here, it’s evolving, and it will become a key component of everything we do in the future. You can’t stop evolution. AI presents numerous opportunities to revolutionize public transportation, paving the way for more efficient, sustainable, and user-friendly systems. Here are some of the key opportunities I’m keeping my eyes on: Optimized Routes and Schedules: AI can dynamically adjust routes and schedules based on real-time data, reducing travel times and improving punctuality. Traffic Flow Management: AI can optimize traffic signals and manage congestion, prioritizing public transportation vehicles and enhancing overall traffic flow. Predictive Maintenance: By predicting and addressing maintenance needs before failures occur, AI can reduce repair costs and extend the lifespan of vehicles and infrastructure. Energy Management: AI can optimize energy usage for electric buses and trains, leading to significant cost savings and reduced environmental impact. Real-time Surveillance: AI-powered video analysis can enhance security by detecting suspicious activities and potential threats in real-time. Incident Prediction and Prevention: AI can predict potential accidents or safety issues, allowing for proactive measures to be taken. Personalized Travel Information: AI can provide personalized travel recommendations, real-time updates, and customer support through chatbots and virtual assistants. Seamless Payment Systems: AI can facilitate smart ticketing systems with dynamic pricing and contactless payments, making the payment process smoother for passengers. Smart Resource Allocation: AI can help deploy resources more efficiently, reducing waste and improving the sustainability of transportation networks. Demand Prediction: AI can analyze patterns to forecast future transportation needs, aiding in better planning and resource allocation. Multi-modal Transport Solutions: AI can integrate various modes of transportation (e.g., buses, trains, bikes, ridesharing) into a cohesive system, providing users with seamless end-to-end travel options. Solving the last mile paradigm. Smart City Initiatives: AI in public transportation can be part of broader smart city initiatives, improving overall urban mobility and connectivity. Enhanced Analytics: AI can process vast amounts of data to provide insights and support decision-making processes for transportation authorities and operators. Performance Monitoring: Continuous monitoring and analysis of system performance can lead to ongoing improvements and innovation in public transportation.

Autonomous Vehicles The AV revolution is underway. Driven by breakthroughs in AI, compute, and simulation, and dramatic cost reduction in sensors and hardware, Robotaxis are being tested in several U.S. cities. Globally there are more than 30 companies piloting/scaling fleets. In the U.S. there are 10 million workers who drive for a living: a) 3.5M truck drivers, b) 2M ride-hailing drivers (Uber, Lyft), c) 1M delivery van drivers (UPS, FedEx, Courier), d) 500k bus drivers (school & transit), e) 400k taxis, and f) 3M drivers in the GIG economy (food delivery) - representing 6.25% of the total workforce. Globally, there are ~400M workers globally that drive for a living. The truck driver or Uber driver replaced by AV is estimated to cut costs per mile by more than half. The implications are massive. In the U.S annually, auto accidents result in 44,000 fatalities, 2.3 million injuries with an economic cost of $350 billion annually (medical, productivity loss, property damage, legal expense). AVs are expected reduce accidents by 90%+. AI on wheels as one analyst labels it, is powered by neural networks, trained on billions of road miles (Waymo alone has logged 100 million with no human driver behind the wheel). Tesla recently launched its pilot program at a price point well below Uber ($4.20 per ride), while Uber itself plans to deploy 20,000 AV (no driver). Bank of America estimates a $1.2 trillion AV spend on robotaxis, logistics, delivery, agriculture, and public transit. This shift could redefine urban design, free up parking, reduce congestion, and accelerate the timeline for traditional auto ownership where more people use AVs on demand vs. owned vehicles. China may lead the race given its demographic urgency and regulatory structure, but the U.S. isn’t far behind. The winners will be OEMs who master software, data, hardware integration, cost-efficient assemblage. Key technology and components are Radar, LiDAR, Camera, Chips, Cockpit to console with nearly 100 companies providing parts, technology and components that has largely evolved beyond traditional auto parts suppliers My most immediate questions/issues related to the advancement of AV include: - Employment, and potential displacement of active drivers - Demand and profitability for the auto OEMs (GM, Ford, Stellantis vs. Tesla)—new car sales, adoption, fleet size, efficiency. - Auto Parts Supplier relevance in a AV transport world - Rental Car Companies (Avis, Hertz, Budget) vs. Robotaxi model - Auto Insurance, premium vs. payout model with fewer accidents and Tesla providing vehicle insurance from their insurance arm The auto sector has underperformed in 2025; credit spreads have widened. Stay tuned, it’s early days.

Autonomous vehicles leveraging advanced AI like Vision Transformers highlight the potential for safer, smarter transportation systems, where real-time decisions driven by enhanced image analysis could redefine how we navigate urban environments and beyond. Vision Transformers (ViTs) utilize attention mechanisms to process diverse visual inputs simultaneously, enhancing the accuracy of object recognition and decision-making in autonomous vehicles. ViTs require substantial investment in R&D, collaborative partnerships, and regulatory alignment to ensure safe and reliable integration. Training technical staff and gaining public trust remain essential steps for widespread adoption, while companies must also address the cost implications to position themselves competitively in a rapidly evolving market. #AI #AutonomousDriving #VisionTransformers #FutureMobility #Transportation