On device learning could dramatically improve user experience, says Qualcomm Research.
Much hope for on-device training has been pinned on a hybrid approach, pooling edge devices to aggregate model perturbations in the cloud and then distributing updated models back to the devices. Each device must adapt the model based on local data, then aggregate updates across multiple users globally for improved model performance across a broader range of observed data.
Another approach is to reduce memory requirements. Instead of storing every layer’s activations to calculate the gradient of the loss function, Qualcomm AI Research is investigating using “invertible layers” to reduce memory for training significantly. For example, MobileNet-V2 training was accomplished with an 11x reduction in activation memory, from 43MB to 3.7 MB, without a meaningful reduction in prediction accuracy or change to the number of inference FLOPS or model parameters.
France Dernières Nouvelles, France Actualités
Similar News:Vous pouvez également lire des articles d'actualité similaires à celui-ci que nous avons collectés auprès d'autres sources d'information.
New Research on Financial Infidelity in Romantic RelationshipsHow to better understand a partner's money decisions and not get blindsided by a financial betrayal, writes ArashEmamzadeh
Lire la suite »
NASA launches rocket from Poker Flats Research Range to study auroraNASA launched a research rocket from the Poker Flats Research Range to study an anomaly in the aurora.
Lire la suite »
California allows school children to enter classroom without masksAt Las Positas Elementary School in Livermore, some students will experience a day of learning without a mask for the first time in their learning career.
Lire la suite »
BMW, Qualcomm And Arriver To Collaborate On New Driver Assist And AutomationIn November 2021, Qualcomm announced that its new Snapdragon Ride compute platform for advanced driver assist systems (ADS) and partially automated driving (ADS) had been selected for future BMW vehicles.
Lire la suite »
Is Emotional Neglect From Childhood Holding You Back?People who grew up feeling like their thoughts and emotions didn't count often have trouble expressing themselves as adults. Here's how they can take back their voice.
Lire la suite »
CBDCs Are A Very Bad Idea | HackerNoonLearn the risks that Central bank digital currencies (CBDCs) pose to your monetary freedom and privacy.
Lire la suite »