WP34s: SLVQ implementation



#4

I just noticed that SLVQ may return results with slight errors even in relatively simple cases:

  -1 ENTER
-1 ENTER
1 SLVQ
 
WP34s results correct (16 digits)
 
0,61803 39887 49895 0 0,61803 39887 49894 8
1,61803 39887 49894 1,61803 39887 49895
With 39 internal digits a correct 16-digit result should be no problem. So what's going on here?

Dieter


#5

If I'm not mistaken, SLVQ is not implemented natively but in user code (XROM). So the normal round-off errors may occur.

#6

Solve is a user code program so much work isn't carried out in high precision (some is still). It also searches at display accuracy (i.e. using the approximately equal test).

Thus, some lower order digits errors are to be expected.


- Pauli


Possibly Related Threads…
Thread Author Replies Views Last Post
  41 SOLVE & INTEG Bank-switched Implementation. Ángel Martin 0 927 06-21-2013, 11:31 AM
Last Post: Ángel Martin
  [WP34S] WP34S firmware on the AT91SAM7L-STK dev kit? jerome ibanes 1 1,232 10-04-2012, 04:59 PM
Last Post: Paul Dale
  [wp34s] Incomplete Gamma on the wp34s Les Wright 18 5,256 12-06-2011, 11:07 AM
Last Post: Namir
  [wp34s] Romberg Integration on the wp34s Les Wright 2 1,511 12-04-2011, 10:49 PM
Last Post: Les Wright
  HMS+ / HMS- implementation. Alex L 10 3,079 02-12-2008, 10:12 AM
Last Post: Alex L
  17IIB TAN implementation Jan (Switzerland) 1 942 07-16-2002, 12:21 PM
Last Post: W. Bruce Maguire II

Forum Jump: