Huanyang VFD and Mesa 7i76e stuck at 6000 rpm

It sounds like the drive runs at 6000 RPM for 0V input
if so the lincurve values are wrong since you want a
Y value (output) of 0 at a commanded RPM of 6000

Also if you have a output scale of 26000 and a maxoutput of 24000
you can never get full output (these should both be left at 24000)

the thing is at m3 s1 where it shouldnt be turning i measure 0.03v and get perfect 6000 rpm
at m3 s6000 i get 2.3 v and 10300 rpm and at m3 s7000 i get 2.7 volt and 11000 rpm

i already changed that output scale back to 24000 but it didnt change anything

Right, so your linscale values are wrong,
Y should be 0 when X is 6000, you have that backwards

so it should be this way:

Point 02 is wrong and will cause you to get about 2.5V with a 6000 RPM command instead of 0V

Do you get 24000 RPM at 10V?

the maximum is 23xxx rpm at 9.1 volt