Coursera: Machine Learning (Week 2) Quiz - Linear Regression with Multiple Variables | Andrew NG

▸ Linear Regression with Multiple Variables :



  1. Suppose m=4 students have taken some classes, and the class had a midterm exam and a final exam. You have collected a dataset of their scores on the two exams, which is as follows:
    enter image description here
    You’d like to use polynomial regression to predict a student’s final exam score from their midterm exam score. Concretely, suppose you want to fit a model of the form , where is the midterm score and x_2 is (midterm score)^2. Further, you plan to use both feature scaling (dividing by the “max-min”, or range, of a feature) and mean normalization.
    What is the normalized feature ? (Hint: midterm = 69, final = 78 is training example 4.) Please round off your answer to two decimal places and enter in the text box below.
  2. -0.47






  1. You run gradient descent for 15 iterations with and compute after each iteration. You find that the value of decreases slowly and is still decreasing after 15 iterations. Based on this, which of the following conclusions seems most plausible?
    • Rather than use the current value of α, it’d be more promising to try a larger value of α (say = 1.0).
    • Rather than use the current value of α, it’d be more promising to try a smaller value of α (say = 0.1).
    • = 0.3 is an effective choice of learning rate.

  1. You run gradient descent for 15 iterations with and compute after each iteration. You find that the value of decreases quickly then levels off. Based on this, which of the following conclusions seems most plausible?
    • Rather than use the current value of α, it’d be more promising to try a larger value of α (say = 1.0).
    • Rather than use the current value of α, it’d be more promising to try a smaller value of α (say = 0.1).
    • = 0.3 is an effective choice of learning rate.






  1. Suppose you have m = 23 training examples with n = 5 features (excluding the additional all-ones feature for the intercept term, which you should add). The normal equation is . For the given values of m and n, what are the dimensions of , X, and y in this equation?
    • X is 23 × 5, y is 23 × 1, θ is 5 × 5
    • X is 23 × 6, y is 23 × 6, θ is 6 × 6
    • X is 23 × 6, y is 23 × 1, θ is 6 × 1
    • X has m rows and n+1 columns (+1 because of the term). y is m-vector. is an (n+1)-vector
    • X is 23 × 5, y is 23 × 1, θ is 5 × 1






  1. Suppose you have a dataset with m = 1000000 examples and n = 200000 features for each example. You want to use multivariate linear regression to fit the parameters to our data. Should you prefer gradient descent or the normal equation?
    • Gradient descent, since it will always converge to the optimal θ.
    • Gradient descent, since will be very slow to compute in the normal equation.
    • With n = 200000 features, you will have to invert a 200001 x 200001 matrix to compute the normal equation. Inverting such a large matrix is computationally expensive, so gradient descent is a good choice.
    • The normal equation, since it provides an efficient way to directly find the solution.
    • The normal equation, since gradient descent might be unable to find the optimal θ.

Check-out our free tutorials on IOT (Internet of Things):


  1. Which of the following are reasons for using feature scaling?
    • It is necessary to prevent gradient descent from getting stuck in local optima.
    • The cost function for linear regression has no local optima.
    • It speeds up solving for θ using the normal equation.
    • The magnitute of the feature values are nsignificant in terms of computational cost.
    • It prevents the matrix (used in the normal equation) from being non-invertable (singular/degenerate).
    • Feature scaling has nothing to do with matrix inversion.
    • It speeds up gradient descent by making it require fewer iterations to get to a good solution.
    • Feature scaling speeds up gradient descent by avoiding many extra iterations that are required when one or more features takes on much larger values than he rest.

Click here to see solutions for all Machine Learning Coursera Assignments.
&
Click here to see more codes for Raspberry Pi 3 and similar Family.
&
Click here to see more codes for NodeMCU ESP8266 and similar Family.
&
Click here to see more codes for Arduino Mega (ATMega 2560) and similar Family.

Feel free to ask doubts in the comment section. I will try my best to answer it.
If you find this helpful by any mean like, comment and share the post.
This is the simplest way to encourage me to keep doing such work.


Thanks & Regards,
- APDaga DumpBox

12 Comments

  1. can you please show how you got the answer to question1

    ReplyDelete
  2. can you please show how you got the answer to question1

    ReplyDelete
  3. I tried to solve Question 1:
    I used mean Normalization:
    (4761 - mean)/standard deviation
    and I got answer = -0.95

    Can you tell me what I am doing wrong?

    ReplyDelete
    Replies
    1. As per my calculations,
      ANS = (4761 - mean) / (max - min)

      means = avg = (7921 + 5184 + 8836 + 4761)/4 = 6675.7
      (max - min) = 8836 - 4761 = 4075

      So, ANS = (4761 - 6675.5) / 4075 = -0.4698 = -0.47

      Delete
    2. OK thanks.I got it.
      I was dividing by standard deviation.

      Delete
    3. why did you use 4761 in formulae

      Delete
    4. In the question itself it asked normalization feature for x_2^{(4)} (i.e. 4th entry for x_2)
      Please check the table given in the question. x_2^{(4)} = 4761

      Delete
  4. Here, two techniques to perform Feature Scaling are mentioned:

    https://www.geeksforgeeks.org/ml-feature-scaling-part-2/

    But why following formula is mentioned in Coursera course and in question 1 also?

    (x - mean) / {max - min)

    Please help me to clear this.

    ReplyDelete
    Replies
    1. Yes. There are more than 1 method for feature scaling. But as this is quiz for particular course, you should follow the method taught in the course. On top of that, It's clearly mentioned in the question itself to use max-min or range to solve the problem.

      "...feature scaling (dividing by the “max-min”, or range, of a feature) and mean normalization."

      Please read the question once again.

      Delete
  5. My question in the 1st que is X² so i am getting-0.36 but it is showing wrong can u help me with this

    ReplyDelete
    Replies
    1. round off your answer to two decimal places.the answer is -0.37

      Delete
Post a Comment
Previous Post Next Post