feat(streaming): async producer + SharedDirFeatureStore (#3094)

* feat(streaming): async producer and shared-dir feature store

Signed-off-by: Kashif Rasul <kashif.rasul@gmail.com>

* fix(streaming): per-instance shared-dir residency, single-use pipeline, discard orphans

Signed-off-by: Kashif Rasul <kashif.rasul@gmail.com>

* fix(streaming): address async pipeline review feedback

Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

---------

Signed-off-by: Kashif Rasul <kashif.rasul@gmail.com>
Signed-off-by: HuiyingLi <willwin.lee@gmail.com>
Co-authored-by: HuiyingLi <willwin.lee@gmail.com>