Thanks to GetMem, I wrote the component: TF1DBEditButton.
It is a combination of a Panel, DBEdit , and BitBtn. The important properties are:
1. OnButtonClick event: do what ever you like when the user click the button
2. Glyph: to set the button glyph
3. ButtonWidth: width of the button
Files attached are the component package and a small demo project.