AI News Hub Logo

AI News Hub

Why ERP integrations silently fail in production (and how I fixed it in Go)

DEV Community
Steffi

Most integration systems don’t break immediately. They fail silently over time by corrupting your data. I learned this the hard way while building ERP integrations between retailers and suppliers. That retailer exchanged data with its suppliers: inventory updates, orders, shipping notices, and invoices. Each message came from different ERP systems with different formats and validation rules. Now, as I’m preparing for a job interview in the field of ERP integration, I decided to approach this properly. No matter how different the systems were, every integration system I have ever seen has the similar pattern: Reception of HTTP Request: The retailer receives an order via HTTPS or SFTP. Decoding data: The payload is decoded and validated for syntactic correctness. Validation: The data is validated from a business perspective. Mapping: The external data is mapped to the internal model. Response: A response is returned with a status of 201 Created. The biggest mistake I made at the beginning was mixing external formats with internal business logic of the platform. This is the point where most integration systems start to become unmaintainable. The transport model defines the structure of the incoming payload as defined by the supplier, ERP system, or external API. The external payload can change at any time. The internal data model belongs to the retailer’s platform, not to the supplier. It should remain as stable as possible. The internal data model is optimized for business logic. Therefore, I decided to separate this data. We declare a struct, which represents the incoming external payload. type IncomingOrderRequest struct { MessageID string `json:"message_id"` SupplierID string `json:"supplier_id"` Order IncomingOrder `json:"order"` } The second struct represents the order itself: type IncomingOrder struct { OrderID string `json:"order_id"` OrderDate string `json:"order_date"` Currency string `json:"currency"` TotalAmount float64 `json:"total_amount"` Lines []IncomingOrderLine `json:"lines"` } The third struct represents the order lines: type IncomingOrderLine struct { SKU string `json:"sku"` Qty int `json:"qty"` UnitPrice float64 `json:"unit_price"` } These structs together are related to the external transport model. The next two structs are related to the internal data model: type InternalOrder struct { MessageID string OrderID string SupplierID string OrderDate string Currency string TotalAmount float64 Lines []InternalOrderLine } type InternalOrderLine struct { SKU string Qty int UnitPrice float64 } The internal model does not depend on Json and on the ERP system. With the following code snippet we make sure that our endpoint only accepts POST methods: if r.Method != http.MethodPost { http.Error(w, "Method not allowed", http.StatusMethodNotAllowed) return } Any other HTTP methods are rejected. This ensures the system never processes invalid transport data. You should never trust external input - even if it looks clean: err := json.NewDecoder(r.Body).Decode(&req) if err != nil { http.Error(w, "Invalid JSON payload", http.StatusBadRequest) // 400 return } I am validating the data from a business point of view. This is where most production systems fail silently. if req.Order.OrderID == "" { return errors.New("missing order_id") } if req.Order.Currency == "" { return errors.New("missing currency") } if req.Order.TotalAmount 0") } // Lines if len(req.Order.Lines) == 0 { return errors.New("order must contain at least one line") } If there is an error, it sends an HTTP response (402 Unprocessable entity) to the client. err = validateRequest(req) if err != nil { http.Error(w, err.Error(), http.StatusUnprocessableEntity) return } I am translating the external payload to an internal domain model. This is the real architectural boundary that prevents my system from collapsing when external formats change. func mapToInternal(req IncomingOrderRequest) InternalOrder { lines := make([]InternalOrderLine, 0, len(req.Order.Lines)) for _, l := range req.Order.Lines { lines = append(lines, InternalOrderLine{ SKU: l.SKU, Qty: l.Qty, UnitPrice: l.UnitPrice, }) } return InternalOrder{ MessageID: req.MessageID, OrderID: req.Order.OrderID, SupplierID: req.SupplierID, OrderDate: req.Order.OrderDate, Currency: req.Order.Currency, TotalAmount: req.Order.TotalAmount, Lines: lines, } } My REST API should return an HTTP response code that the operation has succeeded. w.Header().Set("Content-Type", "application/json") w.WriteHeader(http.StatusCreated) We create an API endpoint at /orders, which handles the requests using the orderHandler function. func main() { http.HandleFunc("/orders", orderHandler) fmt.Println("Server running on :8080") log.Fatal(http.ListenAndServe(":8080", nil)) } With the REST API up and running, we can now test and see if it works. go run main.go In a second Terminal session, we will use the curl request. curl -X POST http://localhost:8080/orders \ -H "Content-Type: application/json" \ -d '{ "message_id": "msg-1", "supplier_id": "supplier-1", "order": { "order_id": "ord-1", "order_date": "2026–02–01", "currency": "EUR", "total_amount": 100, "lines": [ { "sku": "SKU-1", "qty": 1, "unit_price": 100 } ] } }' If you don’t separate transport and domain models, your system won’t fail immediately — it will fail the moment something external changes. Good integration is not about moving data. Integration systems don’t fail because of code. They fail because they don’t control change. Once you separate transport and domain models, your system becomes resilient by design. You can find the implementation of the code discussed in this article on GitHub. Feel free to clone it and extend it for your own integration use cases. Subscribe to my Substack newsletter to get future articles and engineering breakdowns. If you want to go deeper, I created a premium version of this project on Gumroad. Especially useful if you’re a developer who want to build or understand real-world integration services faster or if you are preparing for backend or ERP integration interviews. Thank you for taking the time to read my articles about building real-world integration services in Go. Happy Coding!