Spiking neural networks (SNNs) are promising brain-inspired energy-efficient
models. Recent progress in training methods has enabled successful deep SNNs on
large-scale tasks with low latency. Particu
Currently there has been increasing demand for real-time training on
resource-limited IoT devices such as smart sensors, which realizes standalone
online adaptation for streaming data without data tra
We show how a recently developed alternative to error-backpropagation through time (error-backpropagation through time), forwardpropagation through time (fpt), can be applied to spiking neural networks (snns).
Unlike error-backpropagation through time, fpt attempts to minimize an ongoing dynamically regularized risk on the loss.
Spiking recurrent neural networks (rnns) are a promising tool for solving a wide variety of complex cognitive and motor tasks, due to their rich temporal dynamics and sparse processing.
However training spiking rnns on dedicated neuromorphic hardware is still an open challenge due mainly to the lack of local, hardware-friendly learning mechanisms that can solve the temporal credit assignment problem and ensure stable network dynamics, even when the weight resolution is limited.
In this paper, we present the design and implementation of monolith, a real-time recommendation system tailored for online training.
Our design has been driven by observations of our applicationworkloads and production environment that reflects a marked departure from other recommendations systems.
Recent breakthroughs in neuromorphic computing show that local forms of
gradient descent learning are compatible with Spiking Neural Networks (SNNs)
and synaptic plasticity. Although SNNs can be scala
We present a framework for compactly summarizing many recent results in
efficient and/or biologically plausible online training of recurrent neural
networks (RNN). The framework organizes algorithms a
Backpropagation is widely used to train artificial neural networks, but its
relationship to synaptic plasticity in the brain is unknown. Some biological
models of backpropagation rely on feedback proj
We offer a pilot study regarding the efficacy of an online social media literacy campaign aimed at empoweringindividuals in indonesia with skills to help them identify misinformation.
Amidst the threat of digital misinformation, we offer a pilot study regarding the efficacy of an online social media literacy campaign aimed at empoweringindividuals in indonesia with skills to help them identify misinformation.
We analyze why naive application of dropout is problematic for policy-gradient learning algorithms and introduce consistentdropout, a simple technique to address this instability.
We demonstrate consistent dropout enables stable training with a2c and ppo in both continuousand discrete action environments across a wide range of dropout probabilities across a wide range of dropout probabilities.
We present a method of online training a deep reinforcement learning agent to drive autonomously on a physical vehicle by using a model-based safety supervisor.
Our solution uses a supervisory system to check if the action selected by the agent is safe or unsafe and ensure that a safe action is always implemented on the vehicle.
We present an approach that decouples an imperfect base generator (an off-the-shelf language model or supervised sequence-to-sequence model) from a separate corrector that learns to iteratively correct imperfect generations.
We show that self-correction improves upon the base generator in three diverse generation tasks-mathematical program synthesis, lexically-constrained generation, and toxicity control-even when the corrector is much smaller than the base generator.
This study investigates the effects of trapping and random domain
distribution-induced variations in hafnium zirconium oxide based ferroelectric
field-effect transistors and their application in neuro
The legacy mobility robustness optimization (MRO) in self-organizing networks
aims at improving handover performance by optimizing cell-specific handover
parameters. However, such solutions cannot sat
Recently, brain-computer interface (BCI) system is aiming to provide
user-friendly and intuitive means of communication. Imagined speech has become
an alternative neuro-paradigm for communicative BCI
Recent work has shown that sparse representations -- where only a small
percentage of units are active -- can significantly reduce interference. Those
works, however, relied on relatively complex regu
Learning image representations without human supervision is an important and
active research field. Several recent approaches have successfully leveraged
the idea of making such a representation invar
We introduce a novel online model-based reinforcement learning algorithm that uses unscented transform to propagate uncertainty for the prediction of the future reward.
Previous approaches either approximate the state distribution at each step of the prediction horizon with a gaussian, or perform monte carlo simulations to estimate the rewards.