Weights and Biases - AI Wiki

Gradient Platform Docs Get Started Free Contact Sales

Search…

Artificial Intelligence Wiki

Topics

Accuracy and Loss

Activation Function

AI Chips for Training and Inference

Artificial General Intelligence (AGI)

AUC (Area under the ROC Curve)

Automated Machine Learning (AutoML)

CI/CD for Machine Learning

Comparison of ML Frameworks

Confusion Matrix

Convolutional Neural Network (CNN)

Datasets and Machine Learning

Data Science vs Machine Learning vs Deep Learning

Distributed Training (TensorFlow, MPI, & Horovod)

Generative Adversarial Network (GAN)

Epochs, Batch Size, & Iterations

Features, Feature Engineering, & Feature Stores

Gradient Boosting

Gradient Descent

Hyperparameter Optimization

Interpretability

Jupyter Notebooks

Linear Regression

Logistic Regression

Long Short-Term Memory (LSTM)

Machine Learning Operations (MLOps)

Managing Machine Learning Models

Metrics in Machine Learning

Machine Learning Models Explained

Model Deployment (Inference)

Model Drift & Decay

Overfitting vs Underfitting

Recurrent Neural Network (RNN)

Reproducibility in Machine Learning

Serverless ML: FaaS and Lambda

Structured vs Unstructured Data

Supervised, Unsupervised, & Reinforcement Learning

Tensor Processing Unit (TPU)

Transfer Learning

Weights and Biases

Powered By GitBook

Weights and Biases

Weights and biases (commonly referred to as w and b) are the learnable parameters of a some machine learning models, including neural networks.
Neurons are the basic units of a neural network. In an ANN, each neuron in a layer is connected to some or all of the neurons in the next layer. When the inputs are transmitted between neurons, the weights are applied to the inputs along with the bias.
A neuron
Weights control the signal (or the strength of the connection) between two neurons. In other words, a weight decides how much influence the input will have on the output.
Biases, which are constant, are an additional input into the next layer that will always have the value of 1. Bias units are not influenced by the previous layer (they do not have any incoming connections) but they do have outgoing connections with their own weights. The bias unit guarantees that even when all the inputs are zeros there will still be an activation in the neuron.
Souce: Mate Labs

Topics - Previous

Transfer Learning

Last modified 1yr ago

Copy link