Best Practices for SFTP File Integration with In-Memory Processing in Creatio Cloud

Hi everyone,

I'm currently working on a file-based integration in Creatio Cloud and wanted to get some feedback from anyone who has implemented something similar.

The integration involves connecting to an external SFTP server, retrieving CSV files, and processing their contents directly in memory using C# rather than downloading them to a local directory.

The general workflow we're considering is:

1. Establish an SFTP connection and retrieve the file as a stream.
2. Parse and validate the CSV records in memory.
3. Transform the records and pass the resulting data to an internal Creatio service for further processing.
4. Capture processing results and handle file archival or disposition on the SFTP server.

I'm particularly interested in understanding the recommended approach for implementing this within Creatio Cloud.

A few questions for the community:

• Has anyone successfully implemented SFTP integration using C# within a Creatio Assembly Package?
• Are there recommended libraries for SFTP connectivity and streaming that work reliably in Creatio Cloud?
• Is processing files directly from a stream within Creatio a supported and practical approach, or are there platform considerations we should account for?
• For larger files, are there recommended patterns for managing memory consumption, execution timeouts, and background processing?
• How have others handled file archival, error recovery, and logging without relying on local filesystem storage?

Our preference is to keep the processing within Creatio using supported C# capabilities rather than introducing an additional external integration service.

I'd appreciate any insight, examples, or recommendations from those who have implemented similar integrations.

Thanks in advance!