【摘 要】
:
Neural architecture search (NAS) methods have been proposed to relieve human experts from tedious architecture engineering.However,most current methods are constrained in small-scale search owing to the issue of huge computational resource consumption.Mea
【机 构】
:
Institute of Artificial Intelligence,Huazhong University of Science and Technology,Wuhan 430074,Chin
论文部分内容阅读
Neural architecture search (NAS) methods have been proposed to relieve human experts from tedious architecture engineering.However,most current methods are constrained in small-scale search owing to the issue of huge computational resource consumption.Meanwhile,the direct application of architectures searched on small datasets to large datasets often bears no performance guarantee due to the discrepancy between different datasets.This limitation impedes the wide use of NAS on large-scale tasks.To overcome this obstacle,we propose an elastic architecture transfer mechanism for accelerating large-scale NAS (EAT-NAS).In our implementations,the architectures are first searched on a small dataset,e.g.,CIFAR-10.The best one is chosen as the basic architecture.The search process on a large dataset,e.g.,ImageNet,is initialized with the basic architecture as the seed.The large-scale search process is accelerated with the help of the basic architecture.We propose not only a NAS method but also a mechanism for architecture-level transfer learning.In our experiments,we obtain two final models EATNet-A and EATNet-B,which achieve competitive accuracies of 75.5% and 75.6%,respectively,on ImageNet.Both the models also surpass the models searched from scratch on ImageNet under the same settings.For the computational cost,EAT-NAS takes only fewer than 5 days using 8 TITAN X GPUs,which is significantly less than the computational consumption of the state-of-the-art large-scale NAS methods.
其他文献
Introducing reconfigurable intelligent surfaces(RISs)greatly improves the wireless propagation environment.Limited to feedback overheads and computing power,the low-complexity precoding and the cost-effective beamforming implementation are urgently demand
Flying ad hoc networks are used for many critical tasks.The network formation for routing data becomes difficult because of the mobility of unmanned aerial vehicles(UAVs).To solve the communication issue,we propose an intelligent cluster routing scheme fo
The Silurian-Devonian interval is an essential period in Earth history for witnessing the rise of sarcopterygian fishes and terrestrial vascular plants.In addition to its implication in global stratigraphic correlation,the precise location of the Silurian
Although low earth orbit(LEO)satellites can provide high-capacity backhaul to serve the ter-restrial network,the performance of terrestrial-satellite communication systems is critically influenced by the coupling of user association and resource allocatio
Integrated circuits(ICs)and optoelectronic chips are the foundation stones of the modern infor-mation society.The IC industry has been driven by the so-called“Moore\'s law”in the past 60 years,and now has entered the post Moore\'s law era.In this pape
The accumulated large amount of satellite magnetic data strengthens our capability of resolving the electrical conductivity of Earth\'s mantle.To invert these satellite magnetic data,accurate and efficient forward modeling solvers are needed.In this stu
In the study of global change since the 1980s,a new field of Earth system science has been established(Wang et al.,2019).However,compared with the rapid development of geoscience technology and the numerous associated achievements,the theoretical progress
Over the last sixty years,the scaling of silicon-based complementary metal-oxide-semiconductor(CMOS)field-effect transistors(FETs)have promoted the rapid development of microelectronic technology.However,the development of Si CMOS technology is currently
Although considerable success has been achieved in urban air quality prediction (AQP) with machine learning techniques,accurate and long-term prediction is still challenging.One of the key issues for existing AQP approaches is that air quality monitoring
Navigation problems of unmanned air vehicles(UAVs)flying in a formation have been inves-tigated recently,where collision avoidance is a significant issue to be addressed.In this paper,we study resource allocation and power control for radar sensing in a m