If you meant "Custom angularjs components" with custom component, then you can do so by using CSS, spans and i elements. F.e. <i class="fa fa-regular fa-circle-check"></i> <-- an example of font-awesome use.
If you didn't mean to add an icon to the rendered component, but an icon for the component in the editor's list: I'm not sure..