Re[2]: [basicstamps] Math questions
Archiver
Posts: 46,084
Wow! Thanks Tracy, I tried to adjust my pot in my voltage divider (that
attached to my A/D) and change my conversion factor but because my conversion
factor was a two-digit number, all I could get was a resolution of 0.08. Like
Ray said, using your formula I can now get 0.05 resolution. Thanks, Dan
______________________________ Reply Separator _________________________________
Subject: Re: [noparse][[/noparse]basicstamps] Math questions
Author:
sentto-1327227-3005-965951600-daniel.d.dangremond=jci.com@returns.onelist.com
at Johnson_Controls
Date: 8/10/2000 7:56 PM
Excellent, Tracy
I wasn't familiar with this operator... your approximation is within 0.01%!
One more thing I learned from this list.
Ray McArthur
> One way to compute this on the BS2 is:
>
> X = X */ 1427
>
> which gives X=1399 out for X=251 in.
>
> */ in effect approximates the fraction, 1399/251~=1427/256.
attached to my A/D) and change my conversion factor but because my conversion
factor was a two-digit number, all I could get was a resolution of 0.08. Like
Ray said, using your formula I can now get 0.05 resolution. Thanks, Dan
______________________________ Reply Separator _________________________________
Subject: Re: [noparse][[/noparse]basicstamps] Math questions
Author:
sentto-1327227-3005-965951600-daniel.d.dangremond=jci.com@returns.onelist.com
at Johnson_Controls
Date: 8/10/2000 7:56 PM
Excellent, Tracy
I wasn't familiar with this operator... your approximation is within 0.01%!
One more thing I learned from this list.
Ray McArthur
> One way to compute this on the BS2 is:
>
> X = X */ 1427
>
> which gives X=1399 out for X=251 in.
>
> */ in effect approximates the fraction, 1399/251~=1427/256.