|
-
November 6th, 2006, 01:02 AM
#1
Floating point accuracy
I have written a shader to show a slice of a 3dimensional volume texture.
the data loaded was .raw file. the values in the file were USHORT values.
When the outputted data was analyzed there was a mismatch between the actual value inputted and the resultant value. When I searched the net I came across an article saying that in NV40 cards odd floating point numbers cannot be shown accurately if the number is above 2048. But I am using G70 graphics card(7800 GTX). Does this card also have the same problem. Any Guyz facing the same problem
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
|
Click Here to Expand Forum to Full Width
|