To Disband a guild click the "Guild" icon on the bottom-right Then click the "Disband Guild" button under the Guild Home tab. Note that this can only be done by the current Guild Master.
A Guild Name shares the same rules as Character Names. This means that when you choose to Disband a guild, the Guild name cannot be used again for 31 days. There is no way to speed up this process.