A method and ALU for implementing logarithmic arithmetic in a multi-stage pipeline is described herein. According to one embodiment, a master function is decomposed into two or more sub-functions. Memory associated with the pipeline stores a look-up table for each stage of the pipeline, where each table represents function values generated based on the corresponding sub-function, and where the look-up table associated with one stage differs from the look-up table(s) associated with at least one other stage. Each stage computes a stage output based on the stage input and the corresponding look-up table. By combining the stage outputs, the multi-stage pipeline outputs the logarithmic arithmetic output.