In this experience report, we describe an approach to ability-based focus groups with sign language users in a remote environment. We discuss our main lessons learned in terms of requirements for sign language-accessibility within research, calling out issues such as the need to address users in their natural language, ensuring translation for all parts of research processes, and including users not only within the conducted method but already within preparation phases. Based on requirements such as these, we argue that HCI research currently faces a dilemma when it comes to hearing researchers working with the sign language user population—having to handle the increasingly emphasized demand for conducting user research with this specific target group while lacking accessible tools and procedures to do so. Concluding our experience report, we address this dilemma by discussing the two sides of its fundamental challenge: Inadequate communication with and insufficient representation of sign language users within research.