Searched refs:a_nom (Results 1 – 1 of 1) sorted by relevance
166 int64_t a_nom = (int64_t)numSamplesToUse * sumXY - sumX * sumY; in fit() local168 *a = divRound(a_nom, div); in fit()171 *err = sumYY - divRound(a_nom * sumXY + b_nom * sumY, div); in fit()