The initial step will be create a new remote in the config where the new remote will be your Shared Drive (remote2). This is possible to configure when you are setting up a Google Drive remote.
when you first posted, there was a template of questions; please answer all the questions
that way we can offer better advice without having to pull everything, post by post.
the latest stable rclone is v1.61.1. are you using that?
please post the full debug output from rclone: can do that two ways.
--- add -vv to your command
--- use a log file, to your command, add --log-level=DEBUG --log-file=/path/to/rclone.log
need to change the file path to match your system.
Note that adding the shared_with_me parameter into the connection string applies it just to the main: remote and not the shared: remote unlike using the --drive-shared-with-me flags.