Operating Environment
The SDK, or runtime environment for low-code deployment packages, is critical to the stability and efficiency of model inference. This article summarizes some problems related to the operating environment and their solutions.
Q: Is the inference time long and time fluctuation large when the model is run locally?
When the GPU is used for model inference, the setting of the GPU has a great influence on the inference efficiency. You can try the following Settings:
1. Lock the maximum clock frequency
Open a command line tool as an administrator: search for cmd, right-click in the results found, and select "Run as administrator".
Check the maximum clock frequency of the deployment computer on the terminal: nvidia-smi-q-d SUPPORTED_CLOCKS
To set the maximum clock frequency displayed：nvidia-smi -lgc 6001
2. Manage the low latency mode in 3D Settings to Super High
3. Set the power management mode to highest performance first
4. Reboot the computer
Q：When connected to upstream and downstream devices, the network swallowing speed is slow
When connecting upstream and downstream devices, especially when connecting cameras, it is found that the network share is close to 100%. This situation will also cause the overall detection rhythm to be affected. Please refer to the following optimization solution:
Open the cache of the network port to the maximum, and adjust the receive cache from 256 to 2048, and the transfer cache from 515 to 2048.
Q: Are low-code programs reported as risky by the system and quarantined for deletion?
The security center of the Windows operating system may mistakenly report low-code programs (such as nonCode.exe) as risky and delete them. As a result, the low-code operating system cannot work properly.
The following uses Windows10 as an example to describe how to add low-code programs to Exclusions to avoid being mistakenly deleted by the security center.
Go to Windows Security Center in Privacy and Security in Desktop Settings
Find "Virus and Threat Protection" in the Windows Security Center, click on it to go to the page, and find "Administrative Settings" under the option "Virus and Virus Protection Settings."
On the management Settings page, click the drop-down list to find "Exclusions and open Add or Remove Exclusions".
After entering the exclusion page, click "Add Exclusion". You can select a file or folder to protect files (folders) in a specified location, or select a file type to protect all files of a certain type.
Still have a question?
Each section should be concise, user-friendly, and direct users to additional resources or documentation when necessary.