Expose new ArtifactManager API to support in-memory artifacts and sub-directory structure

Currently, without the use of a REPL/Class finder, there is no API to support adding in-memory artifacts to the remote Spark Connect session. 

Further, there is currently no API to preserve/impose a sub-directory structure on the files we send over the wire.