If your Windows laptop battery icon shows that it is charging when it is not plugged in at all, your laptop battery or drivers might be faulty. Use these fixes to resolve the issue.

Or simply restart your PC. Turn the system icons on and off via Settings > Personalization> Taskbar > Other system tray icons and see if it helps. Change the Power Plan and see if the icon refreshes.