Search

Your search keyword '"e5 model"' showing total 3 results
Start Over Descriptor "e5 model"
3 results on '"e5 model"'

1. Implementation of language models within an infrastructure designed for Natural Language Processing

Author

Bartosz Walkowiak and Tomasz Walkowiak

Subjects
language model deployment, quantization, llama-2, e5 model, onnx, llama.cpp, clarin-pl, Electrical engineering. Electronics. Nuclear engineering, TK1-9971, Telecommunication, TK5101-6720
Abstract

This paper explores cost-effective alternatives for resource-constrained environments in the context of language models by investigating methods such as quantization and CPUbased model implementations. The study addresses the computational efficiency of language models during inference and the development of infrastructure for text document processing. The paper discusses related technologies, the CLARIN-PL infrastructure architecture, and implementations of small and large language models. The emphasis is on model formats, data precision, and runtime environments (GPU and CPU). It identifies optimal solutions through extensive experimentation. In addition, the paper advocates for a more comprehensive performance evaluation approach. Instead of reporting only average token throughput, it suggests considering the curve’s shape, which can vary from constant to monotonically increasing or decreasing functions. Evaluating token throughput at various curve points, especially for different output token counts, provides a more informative perspective.

Published
2024
Full Text
View/download PDF

2. Implementation of language models within an infrastructure designed for Natural Language Processing.

Author

Walkowiak, Bartosz and Walkowiak, Tomasz

Subjects
*NATURAL language processing, *LANGUAGE models, *GEOMETRIC quantization, *MATHEMATICAL functions, *GRAPHICS processing units
Abstract

This paper explores cost-effective alternatives for resource-constrained environments in the context of language models by investigating methods such as quantization and CPUbased model implementations. The study addresses the computational efficiency of language models during inference and the development of infrastructure for text document processing. The paper discusses related technologies, the CLARIN-PL infrastructure architecture, and implementations of small and large language models. The emphasis is on model formats, data precision, and runtime environments (GPU and CPU). It identifies optimal solutions through extensive experimentation. In addition, the paper advocates for a more comprehensive performance evaluation approach. Instead of reporting only average token throughput, it suggests considering the curve’s shape, which can vary from constant to monotonically increasing or decreasing functions. Evaluating token throughput at various curve points, especially for different output token counts, provides a more informative perspective. [ABSTRACT FROM AUTHOR]

Published
2024
Full Text
View/download PDF

3. The effect of the 5e model in writing on achievement and motivation

Author

Cazibe, Yiğit and Ögenik, Muhlise Çoşkun

Subjects
5E Modeli, Eğitim ve Öğretim, Education and Training, E5 Model
Abstract

Yüksek Lisans Tezi Bu çalışmanın amacı 5E Modeline dayalı yazma eğitiminin başarı ve güdülenme üzerindeki etkisini bulmaktır. Yarı deneysel eylem araştırması olan bu tez, 5E Modeli temelli yazma etkinliklerinin Trakya Üniversitesi Yabancı Diller Yüksek Okulu hazırlık sınıflarındaki öğrencilerinin yazma becerilerindeki başarılarını geliştirmedeki mevcut etkisini araştırmaktadır. Çalışmanın katılımcıları 23, 23 ve 24 kişilik üç sınıftan oluşan toplam 70 öğrenciden oluşmuştur. Öğrencilerin bölümleri Trakya Üniversitesi İngilizce Öğretmenliği ve İngilizce Mütercim Tercümanlık'tır. Çalışma, 2010?2011 eğitim-öğretim yılının güz yarıyılında gerçekleştirilmiştir. Çalışmanın uygulaması 10 hafta boyunca haftada iki saat gerçekleşmiştir. Öğrencilere uygulamadan önce, yazma becerisinde ne kadar başarılı olduklarını görebilmek için ön-test verilmiştir ve daha sonra yazma becerilerini ne kadar geliştirdiklerini belirlemek için aynı test uygulama sonunda son-test olarak verilmiştir. Sonuçlar istatistiksel olarak değerlendirilmiştir. Sonuçlara göre, 5E Modeli temelli yazma eğitiminin öğrencilerin yazma becerilerini geliştirmede ve güdülenmelerini sağlamada olumlu etkisinin olduğu görülmüştür. Anahtar Sözcükler: Yapılandırmacılık, 5E Modeli, yazmada güdülenme Abstract The aim of this study is to find out the effect of writing instruction based on the 5E Model on achievement and motivation. This thesis, which is a quasi experimental action research, explores the probable effects of the 5E Model-based writing activities on promoting the achievement of students? writing skills in prep class students at Trakya University, School of Foreign Languages. The participants of the study consisted of totally 70 students in three classes of 23, 23 and 24. The departments of the students are English Language Teaching and Interpretation and Translation at Trakya University. The study was conducted in the fall term of the academic year of 2010-2011. The application of the study was carried out two hours a week for 10 weeks. The students were given a pre-test before the implementation in order to determine how successful they were in writing skill and then they were given the same test at the end of the study as a post-test in order to find out how much they could improve their writing skill. The results were statistically analyzed. According to the results, the 5E Model-based Writing Instruction had a positive effect on promoting writing skills of the students and fostering motivation in writing. Key Words: Constructivism, the 5E Model, motivation in writing

Published
2011

Catalog

Books, media, physical & digital resources
See catalog results