Open Forum

Expand all | Collapse all

EDI Orders flow into NAV too slowly!!

  • 1.  EDI Orders flow into NAV too slowly!!

    Posted 28 days ago
    Good Afternoon!

    We went live with a MS Dynamics NAV 2017 implementation 14 months ago and while we had major problems at first, we have slowly been able to get things where they should be with the exception of a few areas. To give you some helpful background information first, we are a high volume operation and ship around 8 - 10k orders a week with strict Shipping SLA's that we must meet. Any order that we receive before 3:30pm CST, MUST ship that same day. We have Lanham integrated into NAV for our EDI operations and have 50+ trade partners setup. EDI Orders are managed by external software that we have in place that automatically checks our customer's AS2 and SFTP/FTP connections and places the orders into a network folder before NAV even sees them.

    The major problem that we still face and frankly, have no answers for, is how to speed up the process of importing EDI orders into NAV. It's been an issue since go-live and we need orders to flow into NAV as quickly as humanly possible. We have an automated job setup on the NAV Job Que Entries that imports the EDI Orders and runs 20 minutes after it completes. When it runs, that job checks the folder where our EDI Orders are stored, then categorizes them according to the customer and then it goes customer by customer and imports the order into NAV and creates the Sales Order (We have a separate job that releases the sales order to our WMS Software). This process utterly fails when we get slammed with a high volume of orders at one time. For example, we recently had a customer slam us with 700 orders at once and it took 3 hours for that Job to import all those orders into NAV. Not only does that hurt our ability to ship in a timely manner, but there were an additional 350+ orders that had built up in the 3 hours it took to run.

    I apologize for the long winded background information, but my question is this: Does anyone know of a way to speed up how fast it takes for NAV to import an EDI Order and create the order in NAV? We can't have NAV taking over a minute just to import 1 order and create the sales order. Our desire is to get orders to import as fast as possible. Any ideas would be appreciated.

    Thanks

    ------------------------------
    Nick Knutson
    Southern Enterprises
    Coppell TX
    ------------------------------
    Conference-BCNAVUG_200x200


  • 2.  RE: EDI Orders flow into NAV too slowly!!

    TOP CONTRIBUTOR
    Posted 27 days ago
    Nick your background was excellent.  The EDI experts are also going to need to understand how many lines each of these orders include.  All of the validation that happens when an order is entered manually occurs during the EDI process as well.  My first thought is that the validation routine is causing the lengthy processing time.  Unfortunately I am NOT an EDI expert so I am watching this one to learn more.

    Best of luck!

    ------------------------------
    Jason Nicolaou
    Engagement Manager
    Sikich, LLP
    ------------------------------

    Conference-BCNAVUG_200x200


  • 3.  RE: EDI Orders flow into NAV too slowly!!

    Posted 27 days ago
    I'm not a Nav developer but have worked with Nav for some time and developed a lot of code in other languages.
    In my opinion, SQL server (Assuming this is the database platform you are running on) is not built very well for batch processing.  Combining Nav and SQL server in batch processing, it is even slower.

    I would change the process to pull in 1 file at a time without the categorizing and have that process repeat. I don't know how to translate this into Nav logic but the process would be:


    File exists
       pull in file
       load data
       move file to archive
    Repeat loop

    It makes it easier for us as humans to presort the work for batch processing.  However, a computer doesn't need it.
    If there are people entering orders manually, you may have some issues with table locks when you are hit with that amount of orders at one time.  Process should run on its on Nas and maybe its own VM with a large amount of RAM.  If that is not already in place.



    ------------------------------
    Major Williams
    Farmers Investment Co
    Sahuarita AZ
    ------------------------------

    Conference-BCNAVUG_200x200


  • 4.  RE: EDI Orders flow into NAV too slowly!!

    Posted 26 days ago
    Hi Nick,

    We are on much older versions of NAV and the Lanham EDI software (2009R2 and 55.12 respectively) but the concepts should be the same.
    Could you expand upon why the "then categorizes them according to the customer and then it goes customer by customer and imports the order into NAV and creates the Sales Order" step is in your workflow?
    In our workflow, there is a 'Common Receive' folder where all of the incoming EDI documents are placed. We run the 'Receive All EDI Documents' function on that folder and it processes all of the files and creates the necessary NAV documents from them. We're nowhere near the same scale as you but this will process 40-60 inbound orders (~200 sales lines) in less than a minute. There must be some extraordinary overhead that is slowing your process down.

    ------------------------------
    Stephen Marsh
    Enterprise Services Manager
    Axxess Logistics
    Vaughan
    Canada
    ------------------------------

    Conference-BCNAVUG_200x200


  • 5.  RE: EDI Orders flow into NAV too slowly!!

    Posted 26 days ago
    ​Nick,
    Based on those numbers it looks like the average order creation is taking 15 seconds. While that's faster than manual entry it's far longer than I normally see for creating EDI orders, especially ones with smaller numbers of sales lines. Creating several thousand orders an hour should not be a issue with the performance we see in the newer NAV versions.

    I would recommend starting with a performance review, when looking at a customer's system to address a performance concern I recommend a methodical approach to identify where the bottlenecks are. I start with a review of the server environment configuration and utilization (SQL and Service Tier) to make sure they are not resource limited. ERP Systems like NAV are very active in reading from disk, I rarely see them bottlenecked on CPU utilization. It's also important to make sure there aren't other activities consuming resources (other applications utilizing the same servers, jobs rebuilding indexes or backups occurring during the day, etc). From there I'd break up the order creation process into the individual steps and look for the portions that have the longest run time. Lanham's product splits the received files first, then imports them into NAV data, then creates the orders. While this is typically configured to occur all in the same scheduled task we want to look at each step separately and see where the performance is lagging. This identifies if it is a performance issue with the file share you are using or in NAV, and at what step. From there I'd start looking at the long running queries in SQL, Typically the slow running queries are resolved with adding or updating keys in NAV or revising customizations to improve performance. It's also important to look at the other activities in the database. If you have other functions (batch posting, web service integrations, etc) causing locking for extended periods that effects order creation as well.

    I'm sure these issues can be identified and resolved, and am happy to discuss it with you further. If you'd like to please reach out to me directly, I believe you have my contact info already.

    ------------------------------
    Bryan Whitney
    Lanham Services
    Lake Havasu City AZ
    ------------------------------

    Conference-BCNAVUG_200x200


  • 6.  RE: EDI Orders flow into NAV too slowly!!

    TOP CONTRIBUTOR
    Posted 25 days ago
    Too hard to answer here as I have way too many questions.  I have tons of thoughts on how to best import a file and then create orders as we have 7 different integrations that do this, with one that can import 5000 orders a day.  On top of that we have Avalara for taxes and ChargeLogic for Credit Cards which adds some time to creating an order.

    Please fell free to contact me and we can discuss some best practices on how to do this.

    ------------------------------
    Jason Wilder
    Senior Application Developer
    Stonewall Kitchen
    York ME
    ------------------------------

    Conference-BCNAVUG_200x200


  • 7.  RE: EDI Orders flow into NAV too slowly!!

    GOLD CONTRIBUTOR
    Posted 22 days ago
    What are you using to Processing the EDI Files?  Is it Lanham EDI?  If so what Release are you using?

    ------------------------------
    Justin Falconer
    IT Manager
    Tender Corporation
    Littleton NH
    ------------------------------

    Conference-BCNAVUG_200x200


  • 8.  RE: EDI Orders flow into NAV too slowly!!

    SILVER CONTRIBUTOR
    Posted 20 days ago
    We have had performance gains by writing all Headers first, then all Sales Lines.
    Also, newer NAV my have extensions that are firing code that is not needed.
    Additional indexes and/or removing ones not needed help performance as well.
    Creating smaller imports allows other users to jump in the middle of a large process.
    example - Process a small file, sleep, then process another.​

    Just my 2 cents.

    ------------------------------
    Joseph Flynn
    Sr. Dynamics NAV Developer
    Gold Star Foods INC
    Ontario CA
    ------------------------------

    Conference-BCNAVUG_200x200


  • 9.  RE: EDI Orders flow into NAV too slowly!!

    GOLD CONTRIBUTOR
    Posted 19 days ago
    Do you have the NAV Service Tier that is running the import Job Queue on its own standalone service tier (meaning there are no end-user client connections to that same tier), preferably running on its own server that has direct access (not a network-redirected drive) to the EDI files?

    ------------------------------
    Kyle Hardin
    NAV Developer
    ArcherPoint Inc.
    Duluth GA
    ------------------------------

    Conference-BCNAVUG_200x200


If you've found this thread useful, dive deeper into User Group community content by role