According to this
http://embedded.seattle.intel-research. ... _Bluetooth
you need to be calling it with /dev/ttyAMA0, not just ttyAMA0. I guess it would also make sense to confirm all the modules are laoded or compiled into the kernel too
Although trying it here I get the same result with both which is
BCSP initialization timed out
However that takes 5-10 seconds to return.
If I change bcsp to any I get
Can't set line discipline: Invalid argument
Can't initialize device: Invalid argument
returned immediately. I'm guessing you're getting yours returned immediately too
I should note that I have run a GPS on this UART before so the other processes that are usually setup have been disabled.