My application uses Skylight groups and user roles. When I add a user to the group sometimes, they see the application and sometimes they do not

If the users are already logged in when you assign them to a group, they will only see the application the next time they login.