Updating Hypothesis (ĥ) and/or Parameter θ^ in ML - Python Automation and Machine Learning for ICs - - An Online Book - |
||||||||
Python Automation and Machine Learning for ICs http://www.globalsino.com/ICs/ | ||||||||
Chapter/Index: Introduction | A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | Appendix | ||||||||
================================================================================= In machine learning, θ̂ typically represents the model's parameters. These parameters are used in a hypothesis (ĥ) to make predictions or generate output. The hypothesis h_hat is essentially the model's prediction function, which takes input data and maps it to output predictions. During the training process, the goal is to adjust the model's parameters (θ^) to minimize the difference between the model's predictions (ĥ) and the actual target values in the training data. This is usually done by defining a loss function that quantifies the error between the predictions and the true values. The machine learning algorithm then optimizes the parameters (θ^) by updating them to minimize this loss function. Therefore, updating hypothesis ĥ effectively means updating the model's predictions, and this is achieved by adjusting the model's parameters θ^. The iterative process of minimizing the loss function by updating θ^ is what we commonly refer to as "training" a machine learning model. Thus, updating hypothesis ĥ is equivalent to updating parameter θ^ in machine learning, where the hypothesis and parameters are intimately connected through the training process. In programming, assuming we have a defined gradient_descent function, to plot a graph with weights (w) or parameters (θ) versus cost function, we often need to store each w or θ in a list. On the other hand, for the ML modeling, we only need to return the last w value. To do this, this code is implementing a gradient descent algorithm and plots the cost function over the iterations, and stores each value of w/θ in a list. However, only the last value is stored with reinitialization or overwriting inside a loop so that only the final value is preserved to use in the ML process. ============================================
|
||||||||
================================================================================= | ||||||||
|
||||||||