Your browser doesn't support javascript.
loading
Mostrar: 20 | 50 | 100
Resultados 1 - 3 de 3
Filtrar
Mais filtros










Base de dados
Intervalo de ano de publicação
1.
PLoS One ; 16(6): e0253241, 2021.
Artigo em Inglês | MEDLINE | ID: mdl-34181664

RESUMO

How can we effectively regularize BERT? Although BERT proves its effectiveness in various NLP tasks, it often overfits when there are only a small number of training instances. A promising direction to regularize BERT is based on pruning its attention heads with a proxy score for head importance. However, these methods are usually suboptimal since they resort to arbitrarily determined numbers of attention heads to be pruned and do not directly aim for the performance enhancement. In order to overcome such a limitation, we propose AUBER, an automated BERT regularization method, that leverages reinforcement learning to automatically prune the proper attention heads from BERT. We also minimize the model complexity and the action search space by proposing a low-dimensional state representation and dually-greedy approach for training. Experimental results show that AUBER outperforms existing pruning methods by achieving up to 9.58% better performance. In addition, the ablation study demonstrates the effectiveness of design choices for AUBER.


Assuntos
Modelos Teóricos , Processamento de Linguagem Natural
2.
J Air Waste Manag Assoc ; 62(2): 235-41, 2012 Feb.
Artigo em Inglês | MEDLINE | ID: mdl-22442939

RESUMO

In this study, the physicochemical properties of the char of Indonesian SM coal following heat treatment at various temperatures were evaluated using X-ray photoelectron spectroscopy (XPS), Fourier-transform infrared spectroscopy (FT-IR), scanning electron microscopy (SEM), and morphological and specific surface area analysis. Based on these analyses, heat treatment of coal was determined to be the most effective in increasing the coal rank. In the XPS analysis, the C-O and C-O-C groups and quaternary-N species were found to be of a lower grade coal when the pretreatment temperature decreased, meanwhile the C-C group and pyridinic species increased. In the FT-IR analysis, the collapse of the C-O and C-O-C group was observed due to the collapse of the ether group. In SEM and Brunauer-Emmett-Teller (BET) analysis, a decrease in the ether group was shown to be accompanied with the formation of micropores.


Assuntos
Carvão Mineral/análise , Temperatura Alta , Espectroscopia Fotoeletrônica
3.
J Air Waste Manag Assoc ; 61(3): 254-9, 2011 Mar.
Artigo em Inglês | MEDLINE | ID: mdl-21416751

RESUMO

Eight types of coals of different rank were selected and their fundamental combustion characteristics were examined along with the conversion of volatile nitrogen (N) to nitrogen oxides (NOx)/fuel N to NOx. The activation energy, onset temperature, and burnout temperature were obtained from the differential thermogravimetry curve and Arrhenius plot, which were derived through thermo-gravimetric analysis. In addition, to derive the combustion of volatile N to NOx/fuel N to NOx, the coal sample, which was pretreated at various temperatures, was burned, and the results were compared with previously derived fundamental combustion characteristics. The authors' experimental results confirmed that coal rank was highly correlated with the combustion of volatile N to NOx/fuel N to NOx.


Assuntos
Carvão Mineral/estatística & dados numéricos , Óxidos de Nitrogênio/análise , Nitrogênio/análise
SELEÇÃO DE REFERÊNCIAS
DETALHE DA PESQUISA
...