I doubt this will ever show up in a smartphone as it is not only overkill (how would you even attache 16 cameras to a smartphone) but all the safety, compliance and verification required for the automotive market will make it too expensive to handle a couple cameras on a smartphone
With insane power may come insane power draw... Making a powerful GPU or ISP is not hard, if you're not constrained to a 5W maximum (and only for short bursts) cap.
More interesting to me is the question of the target fab technology. Presumably, along with all the other concerns about redundancy, they want this thing to function even in environments where the car can get really hot. In CA or AZ, that can mean 120+ degrees, and I assume they eventually want to sell to places like Saudi Arabia with occasional temperatures of 140+. I mention this because already I have started seeing IoT objects designed by morons that simply flake out when left outside to operate in CA summer weather. Doubtless we're going to see more of this --- supposedly "all-weather" IoT devices that simply can't cope with more than an hour or so of 120+. Temperatures OUTSIDE the enclosure matter as much as temperatures inside the enclosure for some types of devices...
Toshiba made a custom ASIC for the Nokia 808 to process and downsample 41mp sensor data for stills and full HD video. That phone is a lot faster when shooting compared to the Lumia 1020 which used a Qualcomm ISP for 40mp downsampling.
I'm wondering why ARM wants to target visual-only imaging for automotive applications. Wouldn't LIDAR, radar and infrared have much longer range, especially in foggy weather?
We’ve updated our terms. By continuing to use the site and/or by logging into your account, you agree to the Site’s updated Terms of Use and Privacy Policy.
Facebook
Twitter
RSS
11 Comments
Back to Article
vladx - Tuesday, April 25, 2017 - link
Wow that ISP is insanely powerful, hopefully ARM will make this available to smartphone market in the future.hahmed330 - Tuesday, April 25, 2017 - link
No use for a smartphone. Such ASIL-D certified ISPs are exceptionally expensive and smartphone cameras don't need it unless they are mission critical.vladx - Tuesday, April 25, 2017 - link
Of course I was talking about a scaled back version without all the mission critical certs needed in an auto system.naris - Tuesday, April 25, 2017 - link
I doubt this will ever show up in a smartphone as it is not only overkill (how would you even attache 16 cameras to a smartphone) but all the safety, compliance and verification required for the automotive market will make it too expensive to handle a couple cameras on a smartphonenaris - Tuesday, April 25, 2017 - link
However, I could see ARM developing a simplified, cut-down derivative for smartphone usage.vladx - Tuesday, April 25, 2017 - link
Indeed I thought it was obvious I meant a scaled back version since the full version woukd be way too power-hungry anyways.rbarone69 - Friday, April 28, 2017 - link
To paraphrase the founder of DEC, "There's no reason for anyone to have a computer in their home. "name99 - Tuesday, April 25, 2017 - link
With insane power may come insane power draw...Making a powerful GPU or ISP is not hard, if you're not constrained to a 5W maximum (and only for short bursts) cap.
More interesting to me is the question of the target fab technology. Presumably, along with all the other concerns about redundancy, they want this thing to function even in environments where the car can get really hot. In CA or AZ, that can mean 120+ degrees, and I assume they eventually want to sell to places like Saudi Arabia with occasional temperatures of 140+.
I mention this because already I have started seeing IoT objects designed by morons that simply flake out when left outside to operate in CA summer weather. Doubtless we're going to see more of this --- supposedly "all-weather" IoT devices that simply can't cope with more than an hour or so of 120+. Temperatures OUTSIDE the enclosure matter as much as temperatures inside the enclosure for some types of devices...
vladx - Tuesday, April 25, 2017 - link
Yes of course, I was talking about a scaled back version specifically befitting the smartphone market.serendip - Tuesday, April 25, 2017 - link
Toshiba made a custom ASIC for the Nokia 808 to process and downsample 41mp sensor data for stills and full HD video. That phone is a lot faster when shooting compared to the Lumia 1020 which used a Qualcomm ISP for 40mp downsampling.I'm wondering why ARM wants to target visual-only imaging for automotive applications. Wouldn't LIDAR, radar and infrared have much longer range, especially in foggy weather?
tuxRoller - Friday, April 28, 2017 - link
1.2Gpx/s isn't very much.If it samples @600Hz with 4/3 sensors a frame could be about 1632x1224, or with four cameras each sensor could be 816x612
That dynamic range is crazy, but i suppose they are leaving the hard part of that to the sensors.