in admin - settings, you need to have enable_names and display_name_on_posts enabled (checked) and then make sure prioritize_username_in_ux is disabled (unchecked). note that this also puts their full name in posts and user card and profile. you can see this in the Meta chat which shows full names 
if you only want to show in Chat, iām sure some CSS can hide the full names in other places.