本篇文章給大家分享的是有關(guān)如何在python中使用threading和queue庫實(shí)現(xiàn)多線程,小編覺得挺實(shí)用的,因此分享給大家學(xué)習(xí),希望大家閱讀完這篇文章后可以有所收獲,話不多說,跟著小編一起來看看吧。
實(shí)例化該類后,在.object_func函數(shù)中加入自己的業(yè)務(wù)邏輯,再調(diào)用.run方法即可。
# -*- coding: utf-8 -*- # @Time : 2021/2/4 14:36 # @Author : CyrusMay WJ # @FileName: run.py # @Software: PyCharm # @Blog :/tupian/20230522/Cyrus_May import queue import threading class CyrusThread(object): def __init__(self,num_thread = 10,logger=None): """ :param num_thread: 線程數(shù) :param logger: 日志對象 """ self.num_thread = num_thread self.logger = logger def object_func(self,args_queue,max_q): while 1: try: arg = args_queue.get_nowait() step = args_queue.qsize() self.logger.info("progress:{}\{}".format(max_q,step)) except: self.logger.info("no more arg for args_queue!") break """ 此處加入自己的業(yè)務(wù)邏輯代碼 """ def run(self,args): args_queue = queue.Queue() for value in args: args_queue.put(value) threads = [] for i in range(self.num_thread): threads.append(threading.Thread(target=self.object_func,args = args_queue)) for t in threads: t.start() for t in threads: t.join()
模型參數(shù)選擇實(shí)例
# -*- coding: utf-8 -*- # @Time : 2021/2/4 14:36 # @Author : CyrusMay WJ # @FileName: run.py # @Software: PyCharm # @Blog :/tupian/20230522/Cyrus_May import queue import threading import numpy as np from sklearn.datasets import load_boston from sklearn.svm import SVR import logging import sys class CyrusThread(object): def __init__(self,num_thread = 10,logger=None): """ :param num_thread: 線程數(shù) :param logger: 日志對象 """ self.num_thread = num_thread self.logger = logger def object_func(self,args_queue,max_q): while 1: try: arg = args_queue.get_nowait() step = args_queue.qsize() self.logger.info("progress:{}\{}".format(max_q,max_q-step)) except: self.logger.info("no more arg for args_queue!") break # 業(yè)務(wù)代碼 C, epsilon, gamma = arg[0], arg[1], arg[2] svr_model = SVR(C=C, epsilon=epsilon, gamma=gamma) x, y = load_boston()["data"], load_boston()["target"] svr_model.fit(x, y) self.logger.info("score:{}".format(svr_model.score(x,y))) def run(self,args): args_queue = queue.Queue() max_q = 0 for value in args: args_queue.put(value) max_q += 1 threads = [] for i in range(self.num_thread): threads.append(threading.Thread(target=self.object_func,args = (args_queue,max_q))) for t in threads: t.start() for t in threads: t.join() # 創(chuàng)建日志對象 logger = logging.getLogger() logger.setLevel(logging.INFO) screen_handler = logging.StreamHandler(sys.stdout) screen_handler.setLevel(logging.INFO) formatter = logging.Formatter('%(asctime)s - %(module)s.%(funcName)s:%(lineno)d - %(levelname)s - %(message)s') screen_handler.setFormatter(formatter) logger.addHandler(screen_handler) # 創(chuàng)建需要調(diào)整參數(shù)的集合 args = [] for C in [i for i in np.arange(0.01,1,0.01)]: for epsilon in [i for i in np.arange(0.001,1,0.01)] + [i for i in range(1,10,1)]: for gamma in [i for i in np.arange(0.001,1,0.01)] + [i for i in range(1,10,1)]: args.append([C,epsilon,gamma]) # 創(chuàng)建多線程工具 threading_tool = CyrusThread(num_thread=20,logger=logger) threading_tool.run(args)
運(yùn)行結(jié)果
2021-02-04 20:52:22,824 - run.object_func:31 - INFO - progress:1176219\1
2021-02-04 20:52:22,824 - run.object_func:31 - INFO - progress:1176219\2
2021-02-04 20:52:22,826 - run.object_func:31 - INFO - progress:1176219\3
2021-02-04 20:52:22,833 - run.object_func:31 - INFO - progress:1176219\4
2021-02-04 20:52:22,837 - run.object_func:31 - INFO - progress:1176219\5
2021-02-04 20:52:22,838 - run.object_func:31 - INFO - progress:1176219\6
2021-02-04 20:52:22,841 - run.object_func:31 - INFO - progress:1176219\7
2021-02-04 20:52:22,862 - run.object_func:31 - INFO - progress:1176219\8
2021-02-04 20:52:22,873 - run.object_func:31 - INFO - progress:1176219\9
2021-02-04 20:52:22,884 - run.object_func:31 - INFO - progress:1176219\10
2021-02-04 20:52:22,885 - run.object_func:31 - INFO - progress:1176219\11
2021-02-04 20:52:22,897 - run.object_func:31 - INFO - progress:1176219\12
2021-02-04 20:52:22,900 - run.object_func:31 - INFO - progress:1176219\13
2021-02-04 20:52:22,904 - run.object_func:31 - INFO - progress:1176219\14
2021-02-04 20:52:22,912 - run.object_func:31 - INFO - progress:1176219\15
2021-02-04 20:52:22,920 - run.object_func:31 - INFO - progress:1176219\16
2021-02-04 20:52:22,920 - run.object_func:39 - INFO - score:-0.01674283914287855
2021-02-04 20:52:22,929 - run.object_func:31 - INFO - progress:1176219\17
2021-02-04 20:52:22,932 - run.object_func:39 - INFO - score:-0.007992354170952565
2021-02-04 20:52:22,932 - run.object_func:31 - INFO - progress:1176219\18
2021-02-04 20:52:22,945 - run.object_func:31 - INFO - progress:1176219\19
2021-02-04 20:52:22,954 - run.object_func:31 - INFO - progress:1176219\20
2021-02-04 20:52:22,978 - run.object_func:31 - INFO - progress:1176219\21
2021-02-04 20:52:22,984 - run.object_func:39 - INFO - score:-0.018769934807246536
2021-02-04 20:52:22,985 - run.object_func:31 - INFO - progress:1176219\22
以上就是如何在python中使用threading和queue庫實(shí)現(xiàn)多線程,小編相信有部分知識點(diǎn)可能是我們?nèi)粘9ぷ鲿姷交蛴玫降摹OM隳芡ㄟ^這篇文章學(xué)到更多知識。更多詳情敬請關(guān)注創(chuàng)新互聯(lián)行業(yè)資訊頻道。
標(biāo)題名稱:如何在python中使用threading和queue庫實(shí)現(xiàn)多線程-創(chuàng)新互聯(lián)
當(dāng)前路徑:http://jinyejixie.com/article16/dcihdg.html
成都網(wǎng)站建設(shè)公司_創(chuàng)新互聯(lián),為您提供小程序開發(fā)、用戶體驗(yàn)、定制網(wǎng)站、關(guān)鍵詞優(yōu)化、網(wǎng)站策劃、軟件開發(fā)
聲明:本網(wǎng)站發(fā)布的內(nèi)容(圖片、視頻和文字)以用戶投稿、用戶轉(zhuǎn)載內(nèi)容為主,如果涉及侵權(quán)請盡快告知,我們將會在第一時間刪除。文章觀點(diǎn)不代表本網(wǎng)站立場,如需處理請聯(lián)系客服。電話:028-86922220;郵箱:631063699@qq.com。內(nèi)容未經(jīng)允許不得轉(zhuǎn)載,或轉(zhuǎn)載時需注明來源: 創(chuàng)新互聯(lián)
猜你還喜歡下面的內(nèi)容