Performances of single biometric speaker verification systems are outstanding in clean condition but drop significantly in noisy condition. Implementation of multi-biometric systems is one of the solutions to this limitation. However, in order to ensure the performances of multi-biometric systems are sustained, the optimum weight for the fusion system must be determined correctly according to the quality of current data. This paper proposes the use of fuzzy inference system for weight inference. Two traits i.e., speech and lip are used while Support Vector Machine (SVM) is employed as the classifier in this paper.