One concern there is toxicity. Some woods, especially rosewoods, can cause reactions. A fingerboard is usually oiled rather than clear-coated, so the natural oils of the wood still come in contact with the skin. I recall someone here reporting skin rashes with an exotic fingerboard, but I don't recall the wood involved.