Skip to content

Order Import Infrastructure

VIDEO TRANSCRIPT | Recorded: 2025-10-01 | Verify against current system state

Abstract

Overview of supporting infrastructure for Salesforce order imports. Covers nightly stored procedures that create normalized tables for import scripts, email validation job (Salesforce stricter than Aptify on email formats), Real Magnet unsubscribe import process, Python script for matching open-text school names to Salesforce picklist values, and monitoring a 20,000+ record import that takes approximately 3 hours.

Key Procedures

  • Nightly stored procedures create normalized import tables
  • Email validation job scrubs email formats for Salesforce compatibility
  • Real Magnet unsubscribe import pulls from external system to Salesforce
  • Python script matches school names using fuzzy matching algorithm
  • Run school name matcher when new values need mapping
  • Monitor import progress (1,500 records in 15 minutes = ~3 hours total)
  • Check for flow errors during import
  • Stop at Chargent payment methods for next session

Notable Statements

  • 0:00:11 "It creates these normalized tables that create the data that we use for these scripts that we're running right now."
  • 0:01:06 "This one... ensures that the person records all have a validly formatted email address that Salesforce is going to accept."
  • 0:01:30 "AppDeFi was being pretty lenient on the format of email addresses and Salesforce is not that lenient."
  • 0:02:03 "This pulls information out of real magnet and puts it into a table. This is all of the unsubscribes that have occurred."
  • 0:03:57 "We have an open field format that allows them to enter just about anything. So we had to summarize that."
  • 0:04:07 "Python script does its best to identify how well of a match it is and then match it."
  • 0:05:27 "We definitely need to have a workshop about how this process works."

Systems & Configurations

Systems Mentioned

  • SQL Server (stored procedures, SQL jobs)
  • Salesforce (target system)
  • Real Magnet (email marketing, unsubscribes)
  • Python (school name matching)
  • CData DBamp (data connector)

Specific Configurations

Item Value/Setting Timestamp Notes
Email Job temp_SF_emails 0:00:56 Nightly validation
Unsubscribe Source Real Magnet 0:01:50 External import
Import Size 20,000 records 0:06:16 Current batch
Progress Rate 1,581 / 15 min 0:06:29 ~3 hour estimate
Next Step Chargent Payment Methods 0:07:32 After orders complete

Credentials/Access Mentioned

  • SQL Server job access
  • Git repository for scripts
  • VPN connection (causes disconnects)

Errors & Troubleshooting

  • Issue: Email format rejected by Salesforce
  • Cause: Aptify allowed non-standard email formats
  • Resolution: Nightly email scrubber job validates/cleans formats

  • Timestamp: 0:01:30

  • Issue: VPN disconnections during session

  • Cause: VPN instability
  • Resolution: Disconnect VPN when not running SQL statements
  • Timestamp: 0:04:35

Transcript Gaps & Quality Notes

  • Continuation of order import training
  • Discussion of helper scripts and one-time imports
  • Real Magnet unsubscribe workshop needed
  • School name matching workshop needed
  • McKenna has recent experience with practice site mapping
  • Import left running overnight (~3 hours estimated)