I haven't been there in 20 years, but you could take a songthaew from krabi town to ao nagn for 50 baht. I think it was a 20-30 minute ride.
And from AO nagn you could take a boat to Railey.
But I used to love to stay in Krabi town with numerous cheap guesthouses. I wonder if it has changed much.