In one embodiment, a test process herein may: execute an application under test; monitor execution of the application under test for system calls specific to a particular operating system in which the application under test is being executed; capture a count of system calls specific to the particular operating system during the execution of the application under test; and compute a portability metric based on the count of system calls specific to the particular operating system, the portability metric indicative of how dependent the application under test is on the particular operating system.