15 results on '"Self training"'
Search Results
2. Active learning algorithms for multitopic classification
- Author
-
Universitat Politècnica de Catalunya. Departament d'Enginyeria Telemàtica, Moreno Bilbao, M. Asunción, Ruiz Costa-Jussà, Marta, Bonafonte Pardàs, Guillem, Universitat Politècnica de Catalunya. Departament d'Enginyeria Telemàtica, Moreno Bilbao, M. Asunción, Ruiz Costa-Jussà, Marta, and Bonafonte Pardàs, Guillem
- Abstract
In this master thesis we develop a model that surpasses previous studies to be able to detect cyberbullying and other disorders that are a common behaviour in teenagers. We analyze short sentences in social media with new techniques that haven?t been studied in depth in language processing in order to be able to detect these problems. Deep learning is nowadays the common approach for text analysis. However, struggling with dataset size is one of the most common problems. It is not optimal to dedicate thousands of hours to label data by humans every time we want to create a new model. Different techniques have been used over the years to solve or at least minimize this problem, for instance transfer learning or self-learning. One of the most known ways to solve this is by data augmentation. In this thesis we make use of active learning and self-training to address having restrictions of labelled data. We have used data that has not been labeled to improve the performance of our models. The architecture of the model is composed of a Bert model plus a linear layer that projects the Bert sentence embedding into the number of classes we want to detect. We take advantage of this already functional model to label new data that we will use afterwards to create our final model. Using noise techniques we modify the data so the final model has to predict less structured data and learn from difficult scenarios. Thanks to this technique we were able to improve the results in some of the classes, for instance the F-score modified increases by 7% for substance abuse (drugs, alcohol, etc) and 3% in disorders (anxiety, depression and distress) while keeping the performance of the other classes.
- Published
- 2021
3. A Semi-supervised Approach for De-identification of Swedish Clinical Text
- Author
-
Berg, Hanna, Dalianis, Hercules, Berg, Hanna, and Dalianis, Hercules
- Abstract
An abundance of electronic health records (EHR) is produced every day within healthcare. The records possess valuable information for research and future improvement of healthcare. Multiple efforts have been done to protect the integrity of patients while making electronic health records usable for research by removing personally identifiable information in patient records. Supervised machine learning approaches for de-identification of EHRs need annotated data for training, annotations that are costly in time and human resources. The annotation costs for clinical text is even more costly as the process must be carried out in a protected environment with a limited number of annotators who must have signed confidentiality agreements. In this paper is therefore, a semi-supervised method proposed, for automatically creating high-quality training data. The study shows that the method can be used to improve recall from 84.75% to 89.20% without sacrificing precision to the same extent, dropping from 95.73% to 94.20%. The model’s recall is arguably more important for de-identification than precision.
- Published
- 2020
4. A Semi-supervised Approach for De-identification of Swedish Clinical Text
- Author
-
Berg, Hanna, Dalianis, Hercules, Berg, Hanna, and Dalianis, Hercules
- Abstract
An abundance of electronic health records (EHR) is produced every day within healthcare. The records possess valuable information for research and future improvement of healthcare. Multiple efforts have been done to protect the integrity of patients while making electronic health records usable for research by removing personally identifiable information in patient records. Supervised machine learning approaches for de-identification of EHRs need annotated data for training, annotations that are costly in time and human resources. The annotation costs for clinical text is even more costly as the process must be carried out in a protected environment with a limited number of annotators who must have signed confidentiality agreements. In this paper is therefore, a semi-supervised method proposed, for automatically creating high-quality training data. The study shows that the method can be used to improve recall from 84.75% to 89.20% without sacrificing precision to the same extent, dropping from 95.73% to 94.20%. The model’s recall is arguably more important for de-identification than precision.
- Published
- 2020
5. A Semi-supervised Approach for De-identification of Swedish Clinical Text
- Author
-
Berg, Hanna, Dalianis, Hercules, Berg, Hanna, and Dalianis, Hercules
- Abstract
An abundance of electronic health records (EHR) is produced every day within healthcare. The records possess valuable information for research and future improvement of healthcare. Multiple efforts have been done to protect the integrity of patients while making electronic health records usable for research by removing personally identifiable information in patient records. Supervised machine learning approaches for de-identification of EHRs need annotated data for training, annotations that are costly in time and human resources. The annotation costs for clinical text is even more costly as the process must be carried out in a protected environment with a limited number of annotators who must have signed confidentiality agreements. In this paper is therefore, a semi-supervised method proposed, for automatically creating high-quality training data. The study shows that the method can be used to improve recall from 84.75% to 89.20% without sacrificing precision to the same extent, dropping from 95.73% to 94.20%. The model’s recall is arguably more important for de-identification than precision.
- Published
- 2020
6. A Semi-supervised Approach for De-identification of Swedish Clinical Text
- Author
-
Berg, Hanna, Dalianis, Hercules, Berg, Hanna, and Dalianis, Hercules
- Abstract
An abundance of electronic health records (EHR) is produced every day within healthcare. The records possess valuable information for research and future improvement of healthcare. Multiple efforts have been done to protect the integrity of patients while making electronic health records usable for research by removing personally identifiable information in patient records. Supervised machine learning approaches for de-identification of EHRs need annotated data for training, annotations that are costly in time and human resources. The annotation costs for clinical text is even more costly as the process must be carried out in a protected environment with a limited number of annotators who must have signed confidentiality agreements. In this paper is therefore, a semi-supervised method proposed, for automatically creating high-quality training data. The study shows that the method can be used to improve recall from 84.75% to 89.20% without sacrificing precision to the same extent, dropping from 95.73% to 94.20%. The model’s recall is arguably more important for de-identification than precision.
- Published
- 2020
7. A Semi-supervised Approach for De-identification of Swedish Clinical Text
- Author
-
Berg, Hanna, Dalianis, Hercules, Berg, Hanna, and Dalianis, Hercules
- Abstract
An abundance of electronic health records (EHR) is produced every day within healthcare. The records possess valuable information for research and future improvement of healthcare. Multiple efforts have been done to protect the integrity of patients while making electronic health records usable for research by removing personally identifiable information in patient records. Supervised machine learning approaches for de-identification of EHRs need annotated data for training, annotations that are costly in time and human resources. The annotation costs for clinical text is even more costly as the process must be carried out in a protected environment with a limited number of annotators who must have signed confidentiality agreements. In this paper is therefore, a semi-supervised method proposed, for automatically creating high-quality training data. The study shows that the method can be used to improve recall from 84.75% to 89.20% without sacrificing precision to the same extent, dropping from 95.73% to 94.20%. The model’s recall is arguably more important for de-identification than precision.
- Published
- 2020
8. A Semi-supervised Approach for De-identification of Swedish Clinical Text
- Author
-
Berg, Hanna, Dalianis, Hercules, Berg, Hanna, and Dalianis, Hercules
- Abstract
An abundance of electronic health records (EHR) is produced every day within healthcare. The records possess valuable information for research and future improvement of healthcare. Multiple efforts have been done to protect the integrity of patients while making electronic health records usable for research by removing personally identifiable information in patient records. Supervised machine learning approaches for de-identification of EHRs need annotated data for training, annotations that are costly in time and human resources. The annotation costs for clinical text is even more costly as the process must be carried out in a protected environment with a limited number of annotators who must have signed confidentiality agreements. In this paper is therefore, a semi-supervised method proposed, for automatically creating high-quality training data. The study shows that the method can be used to improve recall from 84.75% to 89.20% without sacrificing precision to the same extent, dropping from 95.73% to 94.20%. The model’s recall is arguably more important for de-identification than precision.
- Published
- 2020
9. Ставлення та перспектива самостійних занять із фізичного виховання студентів ВНЗ
- Author
-
Дзензелюк, Д. О., Dzenzeluk, D., Дзензелюк, Д. О., and Dzenzeluk, D.
- Abstract
The attitude of students to physical self ruining and perspective of self training at extracurricular time at High Educational Institutions have fen considered in the paper., У статті розглядаються ставлення студентів до самостійних занять фізичними вправами та перспектива самостійних занять у позанавчальний час студентів вищих навчальних закладів.
- Published
- 2015
10. Ставлення та перспектива самостійних занять із фізичного виховання студентів ВНЗ
- Author
-
Дзензелюк, Д. О., Dzenzeluk, D., Дзензелюк, Д. О., and Dzenzeluk, D.
- Abstract
The attitude of students to physical self ruining and perspective of self training at extracurricular time at High Educational Institutions have fen considered in the paper., У статті розглядаються ставлення студентів до самостійних занять фізичними вправами та перспектива самостійних занять у позанавчальний час студентів вищих навчальних закладів.
- Published
- 2015
11. Ставлення та перспектива самостійних занять із фізичного виховання студентів ВНЗ
- Author
-
Дзензелюк, Д. О., Dzenzeluk, D., Дзензелюк, Д. О., and Dzenzeluk, D.
- Abstract
The attitude of students to physical self ruining and perspective of self training at extracurricular time at High Educational Institutions have fen considered in the paper., У статті розглядаються ставлення студентів до самостійних занять фізичними вправами та перспектива самостійних занять у позанавчальний час студентів вищих навчальних закладів.
- Published
- 2015
12. Ставлення та перспектива самостійних занять із фізичного виховання студентів ВНЗ
- Author
-
Дзензелюк, Д. О., Dzenzeluk, D., Дзензелюк, Д. О., and Dzenzeluk, D.
- Abstract
The attitude of students to physical self ruining and perspective of self training at extracurricular time at High Educational Institutions have fen considered in the paper., У статті розглядаються ставлення студентів до самостійних занять фізичними вправами та перспектива самостійних занять у позанавчальний час студентів вищих навчальних закладів.
- Published
- 2015
13. Using confidence and informativeness criteria to improve POS-tagging in amazigh
- Author
-
Universitat Politècnica de València. Departamento de Sistemas Informáticos y Computación - Departament de Sistemes Informàtics i Computació, VLC/CAMPUS, Outahajala, Mohamed, Benajiba, Yassine, Rosso, Paolo, Zenkouar, Lahbib, Universitat Politècnica de València. Departamento de Sistemas Informáticos y Computación - Departament de Sistemes Informàtics i Computació, VLC/CAMPUS, Outahajala, Mohamed, Benajiba, Yassine, Rosso, Paolo, and Zenkouar, Lahbib
- Abstract
Amazigh is used by tens of millions of people mainly for oral communication. However, and like all the newly investigated languages in natural language processing, it is resource-scarce. The main aim of this paper is to present our POS taggers results based on two state of the art sequence labeling techniques, namely Conditional Random Fields and Support Vector Machines, by making use of a small manually annotated corpus of only 20k tokens. Since creating labeled data is very time-consuming task while obtaining unlabeled data is less so, we have decided to gather a set of unlabeled data of Amazigh language that we have preprocessed and tokenized. The paper is also meant to address using semi-supervised techniques to improve POS tagging accuracy. An adapted self training algorithm, combining confidence measure with a function of Out Of Vocabulary words to select data for self training, has been used. Using this language independent method, we have managed to obtain encouraging results.
- Published
- 2015
14. Using confidence and informativeness criteria to improve POS-tagging in amazigh
- Author
-
Universitat Politècnica de València. Departamento de Sistemas Informáticos y Computación - Departament de Sistemes Informàtics i Computació, VLC/CAMPUS, Outahajala, Mohamed, Benajiba, Yassine, Rosso, Paolo, Zenkouar, Lahbib, Universitat Politècnica de València. Departamento de Sistemas Informáticos y Computación - Departament de Sistemes Informàtics i Computació, VLC/CAMPUS, Outahajala, Mohamed, Benajiba, Yassine, Rosso, Paolo, and Zenkouar, Lahbib
- Abstract
Amazigh is used by tens of millions of people mainly for oral communication. However, and like all the newly investigated languages in natural language processing, it is resource-scarce. The main aim of this paper is to present our POS taggers results based on two state of the art sequence labeling techniques, namely Conditional Random Fields and Support Vector Machines, by making use of a small manually annotated corpus of only 20k tokens. Since creating labeled data is very time-consuming task while obtaining unlabeled data is less so, we have decided to gather a set of unlabeled data of Amazigh language that we have preprocessed and tokenized. The paper is also meant to address using semi-supervised techniques to improve POS tagging accuracy. An adapted self training algorithm, combining confidence measure with a function of Out Of Vocabulary words to select data for self training, has been used. Using this language independent method, we have managed to obtain encouraging results.
- Published
- 2015
15. Memristor-Based Synapse Design and Training Scheme for Neuromorphic Computing Architecture
- Author
-
AIR FORCE RESEARCH LAB ROME NY INFORMATION DIRECTORATE, Wang, Hui, Li, Hai H, Pino, Robinson, AIR FORCE RESEARCH LAB ROME NY INFORMATION DIRECTORATE, Wang, Hui, Li, Hai H, and Pino, Robinson
- Abstract
Memristors have been rediscovered recently and then gained increasing attentions. Their unique properties, such as high density, nonvolatility, and recording historic behavior of current (or voltage) profile, have inspired the creation of memristor-based neuromorphic computing architecture. Rather than the existing crossbar-based neuron network designs, we focus on memristor-based synapse and the corresponding training circuit to mimic the real biological system. In this paper, first, the basic synapse design is presented. On top of it, we will discuss the training sharing scheme and explore design implication on multi-synapse neuron system. Energy saving method such as self-training is also investigated., The original document contains color images. Presented at IEEE World Congress on Computational Intelligence held in Brisbane, Australia on 10-15 Jun 2012. Prepared in cooperation with the Department of Electrical and Computer Engineering Polytechnic Institute of New York University, Brooklyn.
- Published
- 2012
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.