Remove unused agent and task manager files to streamline the codebase and improve maintainability.