The present disclosure relates to system and method(s) for determining the physical characteristics of fish using image processing and machine learning. Images of fish are captured and preprocessed. Further, characteristics determination machine learning model is trained to identify anatomical segments and calculate physical attributes thereof. These attributes are then used to determine the physical characteristics of the fish.