Results/ Statistics

EVALUATION REPORT

PROJECT NUMBER: 229517-CP-1-2006-1-GR-GRUNDTVIG-G1

PROJECT’S TITLE: FIRST STEPS AUTONOMOUS LEARNING FOR IMMIGRANTS

1. General information on «FIRST STEPS AUTONOMOUS LEARNING FOR IMMIGRANTS».

The project’s aim was to develop, evaluate and disseminate a Package of tools in order to help adult socio-economic immigrants from three Candidate countries (TR, RO, BG) integrate to their host countries and more specifically to DE, IT, GR, improve their potential of employability and help them play an active role in their new societies. Our goal was to provide these specific groups of new immigrants with basic language communication skills and cultural and historical elements of their host countries through an innovative and attractive method of autonomous learning. Aiming to make their “first steps” to their new countries easier and more effective and therefore fasten their integration.

Our package of flexible tools is consisted of: three bilingual, contemporary Phrasebooks including dictionaries (one for each second language taught: DE, IT, EL), three Grammar books including Pronunciation guidance for the relevant languages, three History books including cultural and historical information for each host country and finally, three Audio CDs including native speaker’s pronunciation. Also, our project is be supported by a Web Site translated into seven languages (DE, IT, EL, TR, RO, BG, EN) and by a Forum for online communication of immigrants and immigrant organizations.


2. Participants to the evaluation process

All 7 partners from 6 countries (GR, BG, RO, IT, DE, TR) of our project have evaluated our products to selected number of immigrants in their countries and abroad.

They have all used the same questionnaires translated in the mother tongue languages of the immigrants, and from these questionnaires they have received feedback so as to enable us have statistical results.

We estimate that in total, during our pilot application period, around 145 immigrants from six participating countries (GR, BG, RO, IT, DE, TR) have tested and evaluated our project’s products and have answered questionnaires.

Different institutions that have close connections with immigrants have helped us reach those immigrants and explain them the objectives of our project.
More specifically, we have to thank the following institutions that have helped us reach a satisfactory number of immigrants:

From Germany:
- Quartiersmanagement Pankstraße, an institution, that helps citizens improving the life in their area
- Volkshochschule, governmental adult education centre where people can learn German.
- Elisi Evi e.V., information centre for Turkish women in Berlin
- Ausländerbeirat, Foreigners' Advisory Council of Essen and Herne. The advisory board of this institution maintains close contact with the target group of Turkish immigrants

From Turkey:
- Goethe Instut, Institution teaching German to Turkish students

From Greece:
- Ελληνο-Βουλγαρικός σύλλογος φιλίας και αλληλοβοήθειας (Greek-Bulgarian association of friendship and mutualism)
- Υπουργείο Απασχόλησης, κλάδος αλλοδαπών, Ministry of Labour, section of immigrants and foreigners

From Bulgaria:
- Team of language specialists that was leaded by Ms Tsena Zhelyazkova (expert - Bulgarian academy of sciences)

From Italy:
- Bucovina, Romanian association in Turin
- Carpatina, Romanian association in Turin
- Fratia, Romanian association in Turin

From Romania:
- IGPF, General Inspectorate of Border police,
- OIM Moldova, International Organization of Labour
- JRS, Jesuit Refugee Service Romania

The following results have been gathered by the answers of 145 respondents - immigrants from BG, RO, and TR that have all used the same questionnaire for evaluating the project’s products. The majority of the respondents that agreed to test the materials and answer the questionnaire are females.

Special difficulties, we have encountered in Greece, where the respondents were mainly illegal immigrants from Bulgaria who refused to give their personal information and agreed to answer the questionnaires using only their first name.


3. Methodology

The evaluators had to fill the evaluation form (see sample of the evaluation form questionnaire).
The form included 15 questions (9 closed and 6 open). The methodology used by the partnership to evaluate learning materials gave the possibility to trace participant’s views and opinions on the content of the project.

The majority of the immigrants have already used the products in their daily lives for at least a two months period.

4. Summary of Results

RESULTS FROM THE ANALYSIS OF THE “CLOSED” QUESTIONS

For the purpose of the analysis of the collected data, for the closed questions in the questionnaire, as a positive answer was considered an answer with 4 or 5 points.

According to the results from the “closed” questions the majority of the respondents found the products relevant to their needs and is using the products during their daily life communication.
41% of the respondents have confirmed that the words learned from the phrasebook helped them to understand some basic sentences and communicate in real life situations.
65% of the respondents believe that the Grammar book helped them to acquire skills about the grammar of the target languages.
A high percentage of respondents thinks that the History book has enabled them understand the historic background of the host countries.
The answers concerning the Audio CDs were divided. For some respondents, the Audio Cds were of no use, for another significant percentage the Audio CDs were quite or very useful.
The majority of the respondents agreed that the FIRST STEP’S package had a user- friendly format and would certainly recommend this package to other immigrants.


RESULTS FROM THE ANALYSIS OF THE “OPEN” QUESTIONS

Different answers were given to the "open questions" of the questionnaire and some of these ideas for sure will be used for the future improvement of the content of the products and also in the process of its more effective use by the target groups.

We are presenting here the conclusions of the given answers.

The immigrants made the following suggestions for improving the content and the effectiveness of the materials:

- to add illustrations in the books
- to add more topics which are often part of the everyday life of the immigrants
- to include the words from the dictionary after every dialog of the phrasebook

At all the participants in the survey expressed their satisfaction from the positive impact of the materials on the improvement of their language learning process and find the information included in the materials very useful-especially the practical advices for immigrants included in the package.

According to the participants, the books were written in a simple language which allows the reader to acquire new information and skills in a fast way.

The results of the survey show that the most used elements of the package by the readers are the phrasebook and the audio CD.

As a result of the use of the materials, immigrants gained a lot of experience in autonomous language learning and confirm that:

- they learned a lot of “new” for them words
- they learned how to cope with problems related to immigrant’s life and specific problems which are related to communication with different institutions and organizations working with immigrants
- they improved their pronunciation
- they received a detailed and well-designed information about the history and culture of the target countries
- they feel more self-confident in communicating with other people


EVALUATION BY EXTERNAL SPECIALISTS

In order to make an external evaluation of the products and in order to receive a feedback from professionals in the field of language teaching, a survey was carried out. In the survey took part 8 language teachers and specialists from Bulgaria. Their opinion about the products produced during the project was very positive and as advices for improving the effectiveness of the products they indicated:

- to include parallels between the mother tongue language and the host country’s grammar in the grammar book (where it is possible to do that)
- to describe bigger number of practical examples for the different rules in the grammar book
- to include exercises with keys in the grammar book
- to create longer dialogs for some of the topics of the phrasebook

The scientific team, which worked on the analysis of the pilot application process of the final products of the project “First steps to DE, GR, IT-Autonomous learning for immigrants”, can conclude that the materials were welcomed by the immigrants and will be widely used for the language learning process of the target groups.


STATISTICAL DATA

PROJECT NUMBER: 229517-CP-1-2006-1-GR-GRUNDTVIG-G1
PROJECT’S TITLE: FIRST STEPS AUTONOMOUS LEARNING FOR IMMIGRANTS

The answers the participants to our products’ pilot application gave to the evaluation form questionnaire are summarized as follows:

INFORMATION ABOUT THE TEACHING MATERIALS:

Please answer these questions using scale from 1-5, beginning from the lowest to the highest:

1. To what extent is this product relevant to your learning needs?


1 total answers= 0
2 total answers= 1
3 total answers= 20
4 total answers= 42
5 total answers= 31

2. Have you used this product for your daily life communication to your host country?


1 total answers= 4
2 total answers= 9
3 total answers= 28
4 total answers= 36
5 total answers= 22
Without answers= 1

 

3. Was the vocabulary and phrases learned by the Phrasebook enough for your first acquaintance with your host country’s language?


1 total answers= 2
2 total answers= 0
3 total answers= 10
4 total answers= 41
5 total answers= 32

4. To what extent the guidance for the Grammar book did it help you understand the basic grammar phenomena of your host country’s language?


1 total answers= 0
2 total answers= 5
3 total answers= 22
4 total answers= 34
5 total answers= 31
Without answers= 3

5. To what extent did it help you the synoptic History and culture book learn about your host country’s history and culture?


1 total answers= 1
2 total answers= 5
3 total answers= 20
4 total answers= 33
5 total answers= 28
Without answers= 4

6. To what extent was the AUDIO CD helpful for your needs?


1 total answers= 14
2 total answers= 9
3 total answers= 17
4 total answers= 28
5 total answers= 23
Without answers= 4

7. To what extent was the format of the learning package user- friendly and flexible for the users?


1 total answers= 1
2 total answers= 2
3 total answers= 20
4 total answers= 33
5 total answers= 39

8. To what extent would you be able to recommend it to other immigrants?


1 total answers= 0
2 total answers= 3
3 total answers= 15
4 total answers= 26
5 total answers= 51

9. If you have not used it yet- How likely are you to use it in your daily life?


1 total answers= 1
2 total answers= 8
3 total answers= 18
4 total answers= 30
5 total answers= 24
Without answers= 15


COMMENTS

The following are the most important answers to the open questions:

Please answer the questions with a short comment:

1. What you suggest to improve the content of the product?

- There could be more examples.
- Very user-friendly, but it could have more content.
- Yes.
- There should be more phrases in it.
- The Audio CC needs to be improved.
- I don´t have any suggestions, the product is good.
- I suggest to use more general education knowledge.
- To use more dialogues, more short texts and to improve the Grammar.
- Present, Past and Future tenses should be presented combined.
- More help for communicating in everyday life with the children, for example in school.
- I would suggest to use a lower level in the Grammar, because 90 % of the readers did not even finish the primary school.
- The product is good enough.(2 answers)
- More everyday life expressions
- It should be continued
- Too complex for beginners (2)
- You should put specific language and expressions for the main job where Romanians are employed (4)
- It would be better to put exercises to practise (2)
- It would be better to add the answers in the section „Cerco lavoro” and more examples
- I’d like a smaller size for the books
- It’s difficult
- It would be useful to write a specific section for houses and one for carers, dialogues between carers and employers (often old and sick people)
- CD tracks are too long (too many phrases on the same track)
- There is no need to improve the content of the product. It is very nice but only the speaches in the CD are a bit fast to be understood for the new learners.
- For basic German it is very nice.
- About the topics more and different examples should be given, that can be better.
- It is good and clear, the most important is its explanations are perfect.
- In both books after grammar explanations, example sentences can be more. If the German sentences precede the Turkish translations in CDs it can be better.
- The product is enough.(2 answers)
- The product can be improved by more examples.
- Turkish translations should come just after the German ones.
- The topics in book 1 should be more comprehensible.
- You already did what one can ask for.
- More example sentences are needed.
- Topics should be more detailed.
- The product you have completed can be presented in a CD as an interactive teaching style with a teacher.

2. Was the guidance given with the product useful?

- Yes (31)
- The more often it is used, the better is the learning effect.
- Yes, very useful.
- The product and the Phrasebook are very user-friendly because they are in Turkish.
- Yes, I liked it a lot. I was on secondary school, that´s why I was very interested in the themes. The Phrasebook was very helpful.
- Yes, enough.
- Yes, very useful.
- Yes, useful.(2 answers)
- Yes, useful.It includes sufficient information for the people who are about to immigrate to that country.
- It is useful.
- Yes, quite useful.
- Yes, enough. (2 answers)
- Yes, very useful (5 answers)
- Yes, useful (2 answers)
- Yes, information about appilications for papers and links are useful (2)
- Yse, links are useful
- Yes, more examples for the Grammar book would be necessary

3. Was it accessible to immigrants with no previous knowledge of the host country’s language?

- Yes (20)
- Yes, if the people really want to learn something.
- Grammar
- Yes, very helpful.
- A little bit helpful for daily use.
- Yes, if the people really want to learn something.
- Yes, using it at the right time.
- Yes, very helpful for daily use.
- On my opinion the benefits of the products are, that we learn things that we didn´t know before.
- Very helpful, but as I wrote before, I have shown the books to some friends who came to Germany like me without school education and for marriage and they had problems with the books.
- It can be useful for the ones who have the knowledge.
- Yes, included topics are rich in kind , can be very useful.
- Useful but the system is motivating memorizing other than learning.
- Yes, as the first step it is very clear.
- Yes, certainly.
- Useful.
- A very useful product. For the immigrants who have no information about the host country, it provides good information about introducing oneself and helps understand sentence structures and the use of vocabulary.
- It is a useful product.
- I think this product is enough and there is no need to attend a course. For this reason the content of the books should be more detailed.
- Yes, very useful. People can use them.
- A little
- Exactly.
- Your product is very useful. It is a good guide for the immigrants who have no information about the host country.
- Yes, very accessible
- Yes, nearly accessible (2 answers)
- Yes, enough (4 answers)
- Some sections more than others
- The dictionary is very useful when you arrive in Italy
- Yes, in particular the translation of the History book
- Yes, most of all the Phrasebbok
- It can be useful for the ones who have a previous knowledge.
- It’s useful for people with school attendance
- Yes, in short conversations

4. Which parts of the product were more useful to you? (E.g. Phrasebook, Grammar book or History and culture book)

- The Grammar explanations are most useful.
- Phrases that can be used in every day life.
- Yes, very nice.
- Grammar. (6)
- The first book.
- The use of the phrases.
- Everything.
- Phrases that can be used in every day life.
- Syntax and vocabulary.
- The question-answer-examples, there should be more dialogues.
- The knowledge about Grammar and History and everyday life.
- On my opinion the Grammar is the best, but also the Phrasebook
- The Grammar was very helpful. When I have communication problems, I always have a look in it.
- The 1st book and all the information in the 2nd book.
- Basic phrases and grammar parts.
- All, I think what is unknown is useful.
- Introducing ourselves, in short for the first steps: shopping.
- In the 1st book phrases are very useful, furthermore the details in grammar are also useful, the order of contents in the grammar book are chosen carefully.
- Grammar is perfect, enough.
- Grammar is good enough.
- Every section is useful.
- Every section is equally useful.
- The first part of the books is more useful to integrate the host country.
- All books in the product are important. But the 1st and the 2nd are better.
- Meeting, shopping.
- Grammar.
- In the product, all the sentences and vocabulary that we can face in the host country are clearly stated for us. Grammar is even very clear, I am very pleased with them.
- Phrasebook (6 answers)
- Phrasebook, but it doesn’t help to understand Italian people speaking
- Grammar, language, dictionary
- Phrasebook and grammar
- All books (9 answers)
- All books, in particular grammar book
- All books. Culture and History book is an innovation. It’s less useful at the beginning but helps as you go on

5. Have you made any modification at the use of this product?

- Yes (8)
- When I have learned more.
- yes, but I didn´t finish the books
- I have learned something.
- No (21)
- When I have learned more.
- A little bit.
- As I have visited two German classes before, I could understand it more easily than others. In some parts I found answers in these books that I always searched for.
- Yes, the use of book 1 and 2 is very practical.
- Yes, I noticed.
- Yes, a lot.
- They helped me revise the things I learnt at German Course.
- Yes, I realized the improvement but I couldn’t finish them yet.
- Yes, I realized different sentence structures.
- Yes, yes.
- I found grammar part very useful.
- Yes, I improved a lot in a positive way.
- Yes, useful in a positive way.
- I improved a lot as the product is useful but as I said before there should be more examples.
- If more examples are given, more improvement will be gained.
- As I am attending a course, I had the opportunity to observe the product more and to practise more.
- Yes, by the help of your books I can pronounce the words much better. The books are written in a very clear way to be understood easily.
- I found verb conjugations very useful.
- They support the course now I am attending and they are very useful. If I weren’t attending a course, I would like to have the books as a resource anyway.
- In the use of preposition
- No, it’s easy enough
- More conversation exercises are needed
- Degrees of adjectives. I’d like to get more information about means of transport (basic expressions, how to use them, etc.) at the end of the first section of phrasebook.
- I tried to subdivide CD tracks in order to get shorter phrases

6. What have you learned from this product? What were the benefits?

- It was very helpful for syntax.
- What interests me is that I can communicate in and understand everyday life. This is my benefit.
- Grammar (3)
- A lot.
- I have learned to use more sentences.
- I have gained additional knowledge from these books.
- Grammar in mother tongue language.
- The use of language, the development of language.
- Grammar
- Development of language.
- No
- I learned everyday life phrases.
- Grammar
- What interests me is that I can communicate in and understand everyday life. This is my benefit.
- I learned the meaning of many German words.
- The bilingual concept is good, also the Grammar part and the general knowledge about Germany is very good, e.g. law or house hunting.
- The books help understanding the German classes. Our teacher is German and only speaks German. Some parts I did not understand, but the Grammar part was very helpful for understanding the language.
- As unknown words have been also in Turkish in the books, I could learn them more easily. My self-confidence is better now and I try to speak German without being afraid.
- My Grammar knowledge in German is better now. I never understood it, but reading it in Turkish helped me a lot. Thank you.
- I learnt vocabulary and verb conjugations, they helped me revise.
- Basic information, daily language, meeting and grammar but not all.
- Everything except how to make a sentence. Verbs, vocabulary, phrases.
- Numbers, the alphabet and sentences. Very useful before starting a course.
- I found it very useful about the pronouncation. Very useful as they are given with the pronouncation.
- From the product I learnt daily language, practical grammar, and necessary communication skills. I learnt a second language.
- From this product I had practical information about my daily life.
- I have learnt the structure of questions and the structure of sentences that can be given as an answer to the questions.
- I have learnt the structure of questions.
- From this product, I have learnt the first and necessary language that I need on the very first days of mine in the host country.
- Yes, I have learnt a lot. To introduce myself, hours, etc . It is easy to understand because Turkish translation is given at the same time.
- They improved my vocabulary.
- Very useful about the daily language.
- With the course I am attending and with the things I learnt from your product, I had a very successful month.
- I understand grammar easier and quicker (3 answers)
- It’s useful to speak Italian (4 answers)
- I learnt to speak Italian and basic grammar (2 answers)
- I learnt basic talks
- I learnt how to get off at the beginning of my stay in Italy
- I learnt Italian grammar and history
- It was useful to understand better Italian culture
- I improved my knowledge of Italian grammar and vocabulary
- In order too succeed in speaking a foreign language you need study, firmness and knowledge of history and culture
- I improved grammar, speaking and writing
- I learnt lots of new words, how to speak and write correctly
- Before I knew no Italian, I helped me to understand and communicate
- At the beginning, it helped me to make easy talks, to integrate easily: a foreign language is a barrier
- It made the way I was learning Italian methodically
- Now I know more Italian words, I got useful information; I understand Italian history and culture better
- I learnt how to speak Italian better, more information about Italian History and Geography, I improved grammar
- I began to understand a new language



EVALUATION FORM FOR LEARNING MATERIAL
IN TERMS OF SOCRATES PROGRAM
(SUBPROGRAM
: GRUNDTVIG 1)

FOR THE IMMIGRANTS

PRODUCT INFORMATION

Name of product:………………………………………………………………
Name of project:…………………………………………………………………
Main language used:……………………………………………………………

RESPONDENT INFORMATION

Name of person responding: …………………………………………………
Qualification:…………………………………………………………………
Age:…………………………………………………………………………
Sex:…………………………………………………………………………

Address:………………………………………………………………………
Country:………………………………………………………………………
Tel.:…………………………………………………………………………
Fax:…………………………………………………………………………
E-mail:………………………………………………………………………

• How long are you staying in Greece?
…………………………………………………………………………………
• Are you planning to migrate to Greece?
…………………………………………………………………………………

INFORMATION ABOUT THE TEACHING MATERIALS:

  • Please answer these questions using a scale from 1- 5, beginning from the lowest to the highest:

1. To what extent is this product relevant to your learning needs?
□           □              □              □             □
1           2              3              4             5

2. Have you used this product for your daily life communication to your host country?
□           □              □              □             □
1           2              3              4             5

3. Was the vocabulary and phrases learned by the Phrasebook enough for your first acquaintance with your host country’s language?
□           □              □              □             □
1           2              3              4             5

4. To what extent the guidance for the Grammar book did it help you understand the basic grammar phenomena of your host country’s language?
□           □              □              □             □
1           2              3              4             5

5. To what extent did it help you the synoptic History and culture book learn about your host country’s history and culture?
□           □              □              □             □
1           2              3              4             5

6. To what extent was the AUDIO CD helpful for your needs?
□           □              □              □             □
1           2              3              4             5

7. To what extent was the format of the learning package user- friendly and flexible for the users?

□           □              □              □             □
1           2              3              4             5

8. To what extent would you be able to recommend it to other immigrants?

□           □              □              □             □
1           2              3              4             5

9. If you have not used it yet- How likely are you to use it in your daily life?

□           □              □              □             □
1           2              3              4             5


٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭ ٭

COMMENTS

  • Please answer the questions with a short comment:

1. What would you suggest to improve the content of the product?
……………………………………………………………………………

2. Was the guidance given with the product useful?
……………………………………………………………………………

3. Was it accessible to immigrants with no previous knowledge of the host country’s language?
……………………………………………………………………………

4. Which parts of the product were more useful to you? (E.g. Phrasebook, Grammar book or History and culture book)
……………………………………………………………………………

5. Have you made any modification at the use of this product?
……………………………………………………………………………

6. What have you and your pupils learned from this product? What were the benefits?
……………………………………………………………………………

MANY THANKS FOR YOUR HELP IN THE EVALUATION OF THIS PRODUCT!