I think this is tough. I have friends who transferred and socially it can be tough, but if a school is definitely not the right fit, it's better to find out sooner and make a move. I think you're right that this year might be easier to pull back and take some time to evaluate by going online/remote if it's an option.
My DD doesn't move in until September 9, but it's definitely going to be a different freshman year. She's definitely not attending her first choice school (she got a 100% full ride (tuition, room & board, and expenses for undergrad + tuition for a 5th year masters, so she turned down some other more prestigious, slightly better fit options), but the school she's attending is solid and she's really making the best of it. The school is local (which wasn't her first choice), so she's been networking with friends of friends who are attending (or will attend). She's spending a ton of time applying for programs, researching teachers, etc. She was lucky that she was able to live with the roommates she chose (all are from out of state) and she's happy with her housing situation.
In a normal year, I think it would almost always make sense to say stick out the semester (or year), but this year is definitely not normal
Good luck and keep us updated
Mom to a DD (8/02) and a DS (6/05)