Multi-modal preference alignment