There is a hidden site setting to remove the copy button: show_copy_button_on_codeblocks
show_copy_button_on_codeblocks